# sql-server Microsoft SQL Server is a relational database management system whose applications and tools communicate using Transact-SQL (T-SQL). This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles. ## SQL Server to Aurora PostgreSQL conversion with AI agents for AWS DMS DevFeed: [SQL Server to Aurora PostgreSQL conversion with AI agents for AWS DMS]() Original publisher: [Read original article]() Author: Mayur Aggarwal Published: 2026-09-01T15:19:13Z Content type: tutorial Language: en Sources: [AWS Database Blog]() Topics: [AWS Database Migration Service](), [sql-server](), [Database Migration](), [Model Context Protocol](), [Databases]() Tags: [advanced-300](), [ai-agents](), [amazon-aurora](), [aws-database-migration-service](), [database-migration](), [how-to](), [mcp](), [postgresql](), [technical-how-to]() ### AI overview Tutorial on using AI agents with AWS DMS Schema Conversion to convert SQL Server schemas to Aurora PostgreSQL through natural-language workflows. ### Source excerpt Learn how to use AI agents with AWS DMS Schema Conversion to orchestrate SQL Server to Amazon Aurora PostgreSQL schema conversion through natural language. See how the conversion engine processes T-SQL, how the agent drives the workflow, and how to interpret and resolve CRITICAL action items using decision frameworks for common incompatibilities. ## Cross-database access using module signing on Amazon RDS for SQL Server DevFeed: [Cross-database access using module signing on Amazon RDS for SQL Server]() Original publisher: [Read original article]() Author: Nirupam Datta Published: 2026-08-24T18:07:08Z Content type: tutorial Language: en Sources: [AWS Database Blog]() Topics: [Amazon RDS](), [RDS for SQL Server](), [sql-server](), [Security](), [Authorization](), [migration]() Tags: [advanced-300](), [amazon](), [amazon-rds](), [how-to](), [microsoft](), [migration](), [post](), [rds-for-sql-server](), [security](), [sql](), [technical-how-to]() ### AI overview This post explains how to enable secure cross-database access on fully managed Amazon RDS for SQL Server using certificate-based module signing. It presents module signing as an RDS-compatible alternative to TRUSTWORTHY, with permissions limited to specific stored procedures and aligned with least privilege. ### Source excerpt If you need cross-database access on Amazon RDS for SQL Server but cannot enable TRUSTWORTHY, module signing with certificates is the secure, RDS-compatible alternative. This post shows how to grant cross-database permissions to specific stored procedures without TRUSTWORTHY and with a stronger, least-privilege security posture. ## Migrate multilingual full-text search from SQL Server to PostgreSQL DevFeed: [Migrate multilingual full-text search from SQL Server to PostgreSQL]() Original publisher: [Read original article]() Author: Ken Zhang Published: 2026-08-20T20:34:44Z Content type: tutorial Language: en Sources: [AWS Database Blog]() Topics: [PostgreSQL](), [sql-server](), [SQL](), [Amazon Aurora](), [Amazon RDS](), [tokenization]() Tags: [advanced-300](), [amazon](), [amazon-aurora](), [amazon-rds](), [aws](), [blog](), [how-to](), [postgresql](), [postgresql-compatible](), [rds-for-postgresql](), [sql](), [technical-how-to](), [tokenization]() ### AI overview This tutorial explains how to migrate multilingual full-text search from SQL Server to PostgreSQL while preserving comparable behavior. It covers collations, text search configurations, language-specific tokenization, accent-insensitive search, synonym expansion, and validation testing on Amazon Aurora PostgreSQL and Amazon RDS for PostgreSQL. ### Source excerpt Migrating full-text search from SQL Server to PostgreSQL can silently change results because the engines handle text, linguistics, and accents differently. This post shows how to reproduce SQL Server full-text search on Amazon Aurora PostgreSQL and Amazon RDS for PostgreSQL, covering collation, tokenization, accent-insensitive search, and synonyms. ## Kaspersky report examines BitLocker ransomware attacks in Mexico and Colombia DevFeed: [Kaspersky report examines BitLocker ransomware attacks in Mexico and Colombia]() Original publisher: [Read original article]() Author: Kaspersky\_Lab ("Лаборатория Касперского") Published: 2026-07-27T19:52:29Z Content type: news Language: ru Sources: ["Лаборатория Касперского" RU]() Topics: [Security](), [Windows](), [sql-server]() Tags: [bitlocker](), [github](), [mesh](), [ransomware](), [rdp](), [security](), [sql-server](), [tag-9fe8963de219](), [windows]() ### AI overview A Kaspersky report examines ransomware incidents in Mexico and Colombia in which attackers used Windows BitLocker to encrypt organizational data. The reported entry points included exposed RDP and a misconfigured Microsoft SQL Server containing credentials published in GitHub code. ### Source excerpt Свежий отчет "Лаборатории Касперского" разбирает два недавних инцидента в Латинской Америке, в ходе которых организации стали жертвой кибервымогателей. Оба инцидента, произошедшие в мае этого года в Мексике и в июне в Колумбии, удалось подробно проанализировать, в результате чего стали понятны методы взлома корпоративной инфраструктуры, а также дальнейшие шаги киберпреступников. Примечательно, что в обоих случаях для шифрования данных с последующим требованием выкупа использовался штатный инструмент Windows, известный как BitLocker. Значок, указывающий на то, что диск зашифрован, стал первым признаком кибератаки, который заметили в организации. Точкой входа в инциденте, произошедшем в Колумбии, стала доступная из Интернета служба удаленного рабочего стола (RDP) на сервере, к которому, в свою очередь, был подключен жесткий диск объемом 8 терабайт с критически важными финансовыми данными. Злоумышленники сначала получили контроль над системой, изменили учетные данные пользователей, а затем применили шифрование. Еще одной любопытной особенностью данной атаки стала печать записки с требованием выкупа прямо на корпоративных принтерах в офисе организации. Читать далее ## How to Migrate from SQL Server to PostgreSQL HA for Dockerized Apps DevFeed: [How to Migrate from SQL Server to PostgreSQL HA for Dockerized Apps]() Original publisher: [Read original article]() Author: Jessie Baynas Published: 2026-05-28T07:18:00Z Content type: tutorial Language: en Sources: [SeveralNines]() Topics: [PostgreSQL](), [sql-server](), [migration](), [Database Migration](), [Replication](), [Docker Compose](), [Architecture & Design](), [DevOps](), [Monitoring]() Tags: [cloud-native](), [database-general](), [database-migration](), [deployment](), [devops](), [failover](), [migration](), [monitoring](), [open-source](), [postgresql](), [replication](), [sql-server](), [validation]() ### AI overview This tutorial explains how to migrate a database from Microsoft SQL Server to PostgreSQL for Dockerized applications. It separates schema migration with pgloader from bulk data export using BCP and import with PostgreSQL COPY, and describes a setup involving streaming replication and ClusterControl for deployment, monitoring, and failover. ### Source excerpt For many organizations, migrating from Microsoft SQL Server to PostgreSQL is no longer only about reducing licensing costs. The transition is often part of a broader modernization initiative focused on improving flexibility, scalability, and operational efficiency. PostgreSQL has evolved into one of the most mature open-source database platforms available today. It is widely adopted across [...] The post How to Migrate from SQL Server to PostgreSQL HA for Dockerized Apps appeared first on Severalnines. ## Introducing Apache Arrow Support in mssql-python DevFeed: [Introducing Apache Arrow Support in mssql-python]() Original publisher: [Read original article]() Author: Saumya Garg Published: 2026-05-04T04:33:00Z Content type: release Language: en Sources: [Microsoft Python Engineering]() Topics: [sql-server](), [data-processing](), [interoperability](), [data](), [pandas]() Tags: [apache-arrow](), [arrow](), [azure](), [azure-sql](), [client-driver](), [data-processing](), [interoperability](), [pandas](), [python](), [python-driver-for-azure-sql](), [python-driver-for-sql-server](), [sql-server](), [sql-server-2025](), [zero-copy]() ### AI overview Microsoft introduces Apache Arrow support in mssql-python, enabling SQL Server data to be fetched directly into Arrow structures for Polars, Pandas, DuckDB, and other Arrow-native libraries. The approach is intended to reduce Python object creation and memory overhead during data processing. ### Source excerpt Reviewed by Sumit Sarabhai Fetching a million rows from SQL Server into a Polars DataFrame used to mean a million Python objects, a million GC allocations, and then throwing it all away to build a DataFrame. Not anymore. mssql-python now supports fetching SQL Server data directly as Apache Arrow structures - a faster and more [...] The post Introducing Apache Arrow Support in mssql-python appeared first on Microsoft for Python Developers Blog. ## Walking Through an Unplanned Failover: SQL Server Availability Groups on Kubernetes DevFeed: [Walking Through an Unplanned Failover: SQL Server Availability Groups on Kubernetes]() Original publisher: [Read original article]() Author: Anthony Nocentino Published: 2026-04-19T15:00:00Z Content type: tutorial Language: en Sources: [Kubernetes on Anthony Nocentino's Blog]() Topics: [sql-server](), [Availability](), [Kubernetes](), [Databases]() Tags: [automatic](), [availability-groups](), [container](), [containers](), [crash](), [database](), [failover](), [kubernetes](), [load](), [open-source](), [operator](), [recovery](), [sql-server](), [test]() ### AI overview This walkthrough tests unplanned SQL Server Availability Group failover on Kubernetes by force-deleting the current primary pod under idle and sustained HammerDB TPC-C load. Across six force-deletes, the operator automatically promoted new primaries and restored all three replicas, with the article examining detection, recovery behavior, logs, and timing. ### Source excerpt In my planned failover walkthrough, I showed what happens when you deliberately move the primary role to another replica. That's the easy case. Now I want to show what happens when the primary pod just disappears unexpectedly, like during a node failure or a container crash. No graceful shutdown, no demotion, just gone. I ran two test scenarios, each cycling the primary role across all three pods by force-deleting the current primary three times in a row. First, a 5GB TPC-C database idle. Then, that same 5GB database under sustained HammerDB TPC-C load. Six force-deletes total, six successful automatic failovers. I'll walk through the error log from the promoted replica, the operator's detection and recovery behavior, and the full timing data. ## Walking Through a Planned Failover: SQL Server Always On Availability Groups on Kubernetes DevFeed: [Walking Through a Planned Failover: SQL Server Always On Availability Groups on Kubernetes]() Original publisher: [Read original article]() Author: Anthony Nocentino Published: 2026-04-19T05:00:00Z Content type: tutorial Language: en Sources: [Kubernetes on Anthony Nocentino's Blog]() Topics: [sql-server](), [Kubernetes](), [Availability]() Tags: [availability-groups](), [containers](), [failover](), [kubernetes](), [open-source](), [operator](), [sql-server]() ### AI overview A walkthrough of planned failover rotation for a three-replica SQL Server Availability Group managed by sql-on-k8s-operator on Kubernetes. It examines SQL Server error logs, operator reconciliation behavior, and timing under both an idle database and a sustained TPC-C workload. ### Source excerpt When building the sql-on-k8s-operator, I wanted to make sure it could handle both planned and unplanned failovers. The easy case is a planned failover, where you deliberately move the primary role to another replica. The harder case is an unplanned failover, where the primary pod just disappears. The operator needs to handle both. I recently ran a full planned failover rotation on a three-replica SQL Server Availability Group managed by sql-on-k8s-operator, and I want to show you exactly what happens inside SQL Server and the operator during each hop. If you've been following my Introducing the SQL Server on Kubernetes Operator post, this is the logical next step: what does the error log actually look like during a planned failover, what does the operator do in response, and how long does the whole thing take? ## Introducing the SQL Server on Kubernetes Operator DevFeed: [Introducing the SQL Server on Kubernetes Operator]() Original publisher: [Read original article]() Author: Anthony Nocentino Published: 2026-04-12T05:00:00Z Content type: tutorial Language: en Sources: [Kubernetes on Anthony Nocentino's Blog]() Topics: [Kubernetes](), [sql-server](), [Availability](), [Disaster Recovery](), [Open Source]() Tags: [automated](), [automatic](), [availability](), [availability-groups](), [containers](), [disaster-recovery](), [failover](), [high-availability](), [kubernetes](), [open-source](), [operator](), [sql-server]() ### AI overview This tutorial introduces sql-on-k8s-operator, an open-source Kubernetes operator for managing SQL Server workloads. It addresses high availability and disaster recovery by automating lifecycle management, failover, and Always On Availability Group setup, and demonstrates deployment with custom resources. ### Source excerpt Are you considering replatforming your SQL Server workload due to recent vendor changes, but still need high availability and disaster recovery? You're not alone. One of the challenges with running SQL Server on Kubernetes is that there's no Kubernetes operator available. That means no automated lifecycle management, no automatic failover, and no standard way to bootstrap an Always On Availability Group on Kubernetes. I'm excited to share it today as an open-source project: sql-on-k8s-operator. Let's go. ## Write SQL Your Way: Dual Parameter Style Benefits in mssql-python DevFeed: [Write SQL Your Way: Dual Parameter Style Benefits in mssql-python]() Original publisher: [Read original article]() Author: Jahnvi Thakkar Published: 2026-04-07T16:12:05Z Content type: article Language: en Sources: [Microsoft Python Engineering]() Topics: [sql-server](), [Python](), [SQL](), [Microsoft](), [Azure]() Tags: [azure](), [azure-sql](), [client-driver](), [code](), [developers](), [microsoft](), [python](), [python-driver-for-azure-sql](), [python-driver-for-sql-server](), [sql](), [sql-server](), [sql-server-2025]() ### AI overview Microsoft's mssql-python driver now supports both qmark positional parameters and pyformat named parameters for Python applications using SQL Server and Azure SQL. The driver automatically detects the parameter style from the supplied tuple, list, or dictionary, while preserving existing qmark code without configuration changes. ### Source excerpt Reviewed by: Sumit Sarabhai If you've been writing SQL in Python, you already know the debate: positional parameters (?) or named parameters (%(name)s)? Some developers swear by the conciseness of positional. Others prefer the clarity of named. With mssql-python, you no longer need to choose - we support both. We've added dual parameter style support to mssql-python, enabling both qmark and pyformat parameter styles in Python [...] The post Write SQL Your Way: Dual Parameter Style Benefits in mssql-python appeared first on Microsoft for Python Developers Blog. ## Comparing Integers and Doubles DevFeed: [Comparing Integers and Doubles]() Original publisher: [Read original article]() Author: Thomas Neumann (noreply@blogger.com) Published: 2025-11-10T16:55:00Z Content type: article Language: en Sources: [Database Architects]() Topics: [floating-point](), [SQL](), [DuckDB](), [sql-server](), [Programming](), [C++]() Tags: [c-plus-plus](), [compiler](), [duckdb](), [floating-point](), [precision](), [sql](), [sql-server](), [testing](), [undefined-behavior]() ### AI overview The article explains how comparing large integers with double-precision values can lose integer precision and produce non-transitive results in SQL systems. It describes how this can cause differences between ordinary comparisons and hash joins, and outlines a conversion-based approach for correct comparisons. ### Source excerpt During automated testing we stumbled upon a problem that boiled down to transitive comparisons: If a=b, and a=c, when we assumed that b=c. Unfortunately that is not always the case, at least not in all systems. Consider the following SQL query: select a=b, a=c, b=c from (values( 1234567890123456789.0::double precision, 1234567890123456788::bigint, 1234567890123456789::bigint)) s(a,b,c) If you execute that in Postgres (or DuckDB, or SQL Server, or ...) the answer is (true, true, false). That is, the comparison is not transitive! Why does that happen? When these systems compare a bigint and a double, they promote the bigint to double and then compare. But a double has only 52 bits of mantissa, which means it will lose precision when promoting large integers to double, producing false positives in the comparison. This behavior is highly undesirable, first because it confuses the optimizer, and second because (at least in our system) joins work very differently: Hash joins promote to the most restrictive type and discard all values that cannot be represented, as they will never produce a join partner for sure. For double/bigint joins that leads to observable differences between joins and plain comparisons, which is very bad. How should we compare correctly? Conceptually the situation is clear, an IEEE 754 floating point with sign s, mantissa m, and exponent e represents the values (-1)^s*m*2^e, we just have to compare the integer with that value. But there is no easy way to do that, if we do a int/double comparison in, e.g., C++, the compiler does the same promotion to double, messing up the comparison. We can get the logic right by doing two conversions: We first convert the int to double and compare that. If the values are not equal, the order is clear and we can use that. Otherwise, we convert the double back to an integer and check if the conversion rounded up or down, and handle the result. Plus some extra checks to avoid undefined behavior (the conversion of intma ## Simplifying Resource Management in mssql-python through Context Manager DevFeed: [Simplifying Resource Management in mssql-python through Context Manager]() Original publisher: [Read original article]() Author: Jahnvi Thakkar Published: 2025-09-26T09:49:51Z Content type: tutorial Language: en Sources: [Microsoft Python Engineering]() Topics: [Python](), [sql-server](), [Databases](), [Exception]() Tags: [azure](), [azure-sql](), [cleanup](), [client-driver](), [databases](), [exception-handling](), [python](), [python-driver-for-azure-sql](), [python-driver-for-sql-server](), [sql-server](), [sql-server-2025](), [transactions]() ### AI overview This tutorial explains context manager support in the mssql-python driver for Python applications using SQL Server and Azure SQL. It describes how context managers manage connections and cursors, commit successful transactions, roll back transactions when exceptions occur, and close connections automatically. ### Source excerpt Reviewed by: Sumit Sarabhai and Gaurav Sharma If you've worked with databases in Python, you know the boilerplate: open a connection, create a cursor, run queries, commit or rollback transactions, close cursors and connection. Forgetting just one cleanup step can lead to resource leaks (open connections) or even inconsistent data. That's where context managers step [...] The post Simplifying Resource Management in mssql-python through Context Manager appeared first on Microsoft for Python Developers Blog. ## My AI-tweaked Data Saturdays 23 Notes DevFeed: [My AI-tweaked Data Saturdays 23 Notes]() Original publisher: [Read original article]() Published: 2023-11-19T00:00:00Z Content type: article Language: en Sources: [Mutt0-ds Notes]() Topics: [Microsoft](), [Azure](), [sql-server](), [paas and iaas](), [Cloud](), [Databases]() Tags: [azure](), [blog-post](), [chatgpt](), [database](), [event](), [microsoft](), [mssql](), [ocr]() ### AI overview A blog post presents AI-assisted and manually checked notes from Data Saturdays 37 in Parma, covering Microsoft data platform technologies and SQL Server deployment options in Azure, including single databases, elastic pools, managed instances, purchase models, serverless operation, and Hyperscale. ### Source excerpt Last Saturday I had the privilege of attending Data Saturdays 37 at Parma, an event series focused on Microsoft data platform technologies.... ## How to Pass a Table Valued Parameter to a T-SQL Function with jOOQ DevFeed: [How to Pass a Table Valued Parameter to a T-SQL Function with jOOQ]() Original publisher: [Read original article]() Author: lukaseder Published: 2023-04-25T12:16:30Z Content type: tutorial Language: en Sources: [jOOQ]() Topics: [sql-server](), [SQL](), [Java](), [Code]() Tags: [code](), [code-generation](), [code-generator](), [how-to](), [java](), [jdbc](), [jooq](), [jooq-in-use](), [sql-server](), [t-sql](), [table-valued-function](), [table-valued-parameter]() ### AI overview This tutorial explains how to pass a Microsoft T-SQL table-valued parameter to a function using jOOQ. It covers native T-SQL and JDBC usage, then shows how jOOQ's code generator produces Java types and methods for calling the function and accessing its result rows. ### Source excerpt Microsoft T-SQL supports a language feature called table-valued parameter (TVP), which is a parameter of a table type that can be passed to a stored procedure or function. For example, you may write: This function takes a table-valued parameter (TVP), and produces a result set containing the cross product of the parameter table with itself. ... Continue reading How to Pass a Table Valued Parameter to a T-SQL Function with jOOQ -> ## Pre-Conference Workshop and Sessions at PASS Summit DevFeed: [Pre-Conference Workshop and Sessions at PASS Summit]() Original publisher: [Read original article]() Author: Anthony Nocentino Published: 2022-10-16T14:13:18Z Content type: news Language: en Sources: [Kubernetes on Anthony Nocentino's Blog]() Topics: [pass](), [Cloud](), [Azure](), [Kubernetes](), [SQL](), [sql-server](), [data](), [Deployment](), [Disaster Recovery](), [Availability](), [Microsoft]() Tags: [announce](), [availability](), [azure](), [azure-arc](), [cloud](), [community](), [conference](), [data](), [disaster-recovery](), [kubernetes](), [linux](), [microsoft](), [sql](), [sql-server](), [training]() ### AI overview The author announces three presentations at PASS Data Community Summit 2022: a pre-conference workshop on designing hybrid cloud strategies, a regular session on cloud data infrastructure, and a Learning Path session. ### Source excerpt I'm pleased to announce that I will be presenting at this year's PASS Summit. PASS Data Community Summit 2022 is the year's largest gathering of data platform professionals in the US. This year I have a pre-conference workshop, a regular session, and a Learning Path session. Let's dive into each. Pre-Conference Workshop: Become a Hybrid Architect My good friend Ben E. Weissman and I will teach a pre-conference workshop called "Become a Hybrid Architect" in this workshop we will cover the foundations needed to design and build a hybrid cloud strategy for your organization. ## How to Connect to Microsoft SQL Server Remotely Using Teleport DevFeed: [How to Connect to Microsoft SQL Server Remotely Using Teleport]() Original publisher: [Read original article]() Author: travis.rodgers@goteleport.com (Travis Rodgers) Published: 2022-09-20T00:00:00Z Content type: tutorial Language: en Sources: [Teleport]() Topics: [sql-server](), [active directory](), [audit](), [Authentication](), [Security](), [Firewall](), [VPC]() Tags: [active-directory](), [audit](), [authentication](), [firewall](), [how-to](), [security](), [sql-server](), [vpc]() ### AI overview This tutorial explains how to connect to Microsoft SQL Server remotely using Teleport and Active Directory authentication. It recommends Windows authentication, limiting public exposure through network isolation, and enabling auditing for logins, sessions, and SQL queries. ### Source excerpt In this blog post, we'll look at how to connect to Microsoft SQL Server remotely using Teleport and Active Directory Authentication. ## Securing Microsoft SQL Server DevFeed: [Securing Microsoft SQL Server]() Original publisher: [Read original article]() Author: info@goteleport.com (Kainaat Arshad) Published: 2022-07-22T00:00:00Z Content type: tutorial Language: en Sources: [Teleport]() Topics: [sql-server](), [Security](), [Vulnerabilities]() Tags: [best-practices](), [compliance](), [hardening](), [security](), [sql-server](), [vulnerabilities]() ### AI overview An overview of standard practices for securing and hardening Microsoft SQL Server deployments across network, transport, and database levels. It explains risks including weak default settings, SQL injection, denial-of-service attacks, verbose error messages, and compliance gaps. ### Source excerpt An overview of best practices for securing and hardening MS SQL deployments. ## Intro to SQL for the New Grad Developer DevFeed: [Intro to SQL for the New Grad Developer]() Original publisher: [Read original article]() Author: Brandon Raboy Published: 2022-06-08T13:00:00Z Content type: tutorial Language: en Sources: [Nic Raboy]() Topics: [SQL](), [Databases](), [MySQL](), [Oracle Database](), [PostgreSQL](), [sql-server]() Tags: [databases](), [developer](), [guide](), [mysql](), [oracle](), [postgresql](), [rdbms](), [sql](), [sql-server](), [syntax]() ### AI overview A beginner-oriented guide to SQL for new graduate developers. It explains SQL's role in accessing and manipulating databases, surveys MySQL, PostgreSQL, Oracle, and SQL Server, and introduces syntax differences, EXPLAIN, query runtime, and example problems. ### Source excerpt Ever since studying and working with databases 6 months ago, I've become fascinated with SQL and its relatively simple syntax. As a guide to the reader, I've gathered the essential criteria that emplo... The post Intro to SQL for the New Grad Developer appeared first on The Polyglot Developer. ## Scaling Findmypast for 1921 Census release - Part 3 DevFeed: [Scaling Findmypast for 1921 Census release - Part 3]() Original publisher: [Read original article]() Author: Mike Thomas Published: 2022-04-26T00:00:00Z Content type: article Language: en Sources: [Findmypast]() Topics: [Deployment](), [Hardware](), [Kubernetes](), [Network](), [virtual machines](), [Amazon Web Services](), [Linux](), [sql-server](), [Windows](), [ASP.NET](), [C#](), [.NET]() Tags: [aws](), [blog-post](), [c-sharp](), [chaos](), [deployment](), [findmypast](), [hardware](), [infrastructure](), [k8s](), [kubernetes](), [load](), [net](), [network](), [release](), [sql-server](), [stress](), [testing](), [virtual-machines](), [windows]() ### AI overview Findmypast describes the infrastructure challenges involved in scaling its service for the 1921 Census of England and Wales release. The third post in the series examines network timeouts and throughput problems during stress testing, leading the team to investigate hardware, Hyper-V, virtualized networking, Kubernetes, AWS, and related service infrastructure. ### Source excerpt Findmypast (FMP) released the 1921 Census of England & Wales at midnight on Jan 6th 2022 to an eager community of genealogists. The preparation of the census - preservation, digitisation and transcription took three years of hard work. Aside from the data preparation, we also had technical challenges to address. Specifically, could our services deal with the projected increase in users for the first few days of 1921 launch period? This post is the third in a series that details how we approached scaling our service to deal with a projected day one 12x increase of users. Digging deeper into the infrastructure We left the second blog post in a poor position, our scaling efforts were not going well; network timeouts and throughput issues dogged each and every one of our stress test game days. At this point, we started to suspect the issue was related to hardware rather than the services. We started to dig deeper into all layers of the network stack, along with looking at the new Hyper-V hardware. Before we dig too deeply into the things, lets recap on our existing hardware setup. For the search backend, we use SOLR with a cluster of bare metal machines to index and retrieve search results. This was one area where we knew in advance that we needed more resources, so we scaled the cluster into AWS for extra compute. The majority of the Findmypast service runs on K8s, but not on bare metal. The K8s cluster is composed of Linux virtual machines running on Hyper-V. Our Hyper-V setup consisted of two clusters of bare metal machines, however both clusters were running different versions of Hyper-V We also have some areas of the site still running Windows servers with a Microsoft .Net/C# stack with SQL Server backend. These are also virtual machines running on the same Hyper-V hardware. The internal services, staging environments, etc also run as virtual machines under Hyper-V. So, SOLR aside, Hyper-V managed pretty much everything, from our internal deployment process to the ## My Personal Airflow - How I'm monitoring my scripts with Python, Appsmith and SQL Server DevFeed: [My Personal Airflow - How I'm monitoring my scripts with Python, Appsmith and SQL Server]() Original publisher: [Read original article]() Published: 2022-04-21T00:00:00Z Content type: tutorial Language: en Sources: [Mutt0-ds Notes]() Topics: [Monitoring](), [Python](), [sql-server](), [Full-Stack](), [airflow](), [Back end]() Tags: [backend](), [dashboard](), [database](), [full-stack](), [monitoring](), [python](), [scripts](), [sql-server]() ### AI overview A personal project uses Python, SQL Server, and Appsmith to monitor locally run scripts. The author describes the monitoring problem, the proposed backend, database, and frontend, and a Python logging module built around a decorator. ### Source excerpt Here's the story of how I created my first full-stack project for monitoring my daily activities, using Python and SQL Server in backend... ## Published Azure Arc-Enabled Data Services Revealed - Second Edition DevFeed: [Published Azure Arc-Enabled Data Services Revealed - Second Edition]() Original publisher: [Read original article]() Author: Anthony Nocentino Published: 2022-02-26T00:00:00Z Content type: release Language: en Sources: [Kubernetes on Anthony Nocentino's Blog]() Topics: [Azure](), [Cloud](), [sql-server](), [datacenter]() Tags: [arc](), [azure](), [azure-arc](), [backups](), [data](), [hybrid-cloud](), [kubernetes](), [management](), [multi-cloud](), [sql-server]() ### AI overview The authors announce the publication of the second edition of Azure Arc-Enabled Data Services Revealed. The book covers deploying and managing Azure Arc-enabled data services, including SQL Server and PostgreSQL databases, across on-premises, corporate data centers, and cloud environments. ### Source excerpt I'm super proud to announce that Ben E. Weissman and I have published Azure Arc-Enabled Data Services Revealed - Second Edition available now at Apress and your favorite online booksellers! Buy the book now or keep reading below if you need to be more convinced :) A couple of notes about the book first, I enjoyed working with this bleeding-edge tech and collaborating with the SQL Server Engineering Team at Microsoft on this. I want to call out the support from the Azure Arc Enabled Data Services Program Manager at Microsoft, Jes Schultz. Thanks for your support and a fantastic forward. I also want to call out my co-author and friend, Ben; you are an excellent writer. Thank you for including me in this adventure! ## Setting Trace Flags and Configuring SQL Server in Kubernetes DevFeed: [Setting Trace Flags and Configuring SQL Server in Kubernetes]() Original publisher: [Read original article]() Author: Anthony Nocentino Published: 2021-09-12T12:24:45Z Content type: tutorial Language: en Sources: [Kubernetes on Anthony Nocentino's Blog]() Topics: [Kubernetes](), [sql-server](), [configuration](), [Deployment]() Tags: [blog](), [blog-post](), [code](), [configuration](), [containers](), [deployment](), [kubernetes](), [manifest](), [running](), [sql-server](), [sqlserver](), [trace]() ### AI overview A tutorial showing how to configure SQL Server in Kubernetes. It demonstrates overriding a container command to set a Database Engine Service Startup Option and using a ConfigMap to inject an mssql.conf configuration file. ### Source excerpt In this blog post, we will walk through a few examples of configuring SQL Server in Kubernetes. First, we will create a Deployment for SQL Server, override the container's command, and specify a Database Engine Service Startup Option. Second, we will create a Deployment for SQL Server using a ConfigMap to inject an mssql.conf configuration file. Creating a SQL Server Deployment and Overriding the Container's Command and Arguments First up, let's create a Deployment for SQL Server and override the container's command specify a Database Engine Service Startup Option. ## Setting Trace Flags and Configuring SQL Server Containers DevFeed: [Setting Trace Flags and Configuring SQL Server Containers]() Original publisher: [Read original article]() Author: Anthony Nocentino Published: 2021-09-12T11:24:45Z Content type: tutorial Language: en Sources: [Kubernetes on Anthony Nocentino's Blog]() Topics: [sql-server](), [Docker](), [Containers](), [configuration](), [Command-line interface](), [Code]() Tags: [code](), [command-line](), [configuration](), [containers](), [docker](), [examples](), [how-to](), [kubernetes](), [sql](), [sql-server](), [trace](), [volume]() ### AI overview A tutorial on configuring SQL Server in Docker containers. It demonstrates setting trace flags through container startup parameters and configuring SQL Server with an injected mssql.conf file, while explaining how configuration and data persistence relate to the container lifecycle. ### Source excerpt In this blog post, we will walk through a few examples of how to configure SQL Server in Docker Containers. First, we will configure a container at runtime by overriding the default docker command for the container and setting Database Engine Service Startup Options. Second, we're going to inject a configuration file into our container to configure SQL Server. Let's go! Starting a Container with a Trace Flag First up, let's configure a container at runtime using Database Engine Service Startup Options. In Docker you can override the command of a container at the command line so we can start up a container with the correct executable and parameters. I'm configuring a trace flag by setting the correct parameters for the sqlservr executable. So when this container starts up it will start the sqlservr executable with the -T 3226 parameter. Let's check out the code for this... ## SQL Server on Kubernetes Book Published! DevFeed: [SQL Server on Kubernetes Book Published!]() Original publisher: [Read original article]() Author: Anthony Nocentino Published: 2021-08-04T16:01:08Z Content type: release Language: en Sources: [Kubernetes on Anthony Nocentino's Blog]() Topics: [Kubernetes](), [sql-server](), [Azure](), [big-data]() Tags: [announce](), [azure](), [big-data](), [book](), [kubernetes](), [sql-server](), [training]() ### AI overview The authors announce the publication of SQL Server on Kubernetes - Designing and Building a Modern Data Platform. The book covers Kubernetes fundamentals, cluster management, and deploying and operationalizing SQL Server in on-premises and Azure environments, including high-availability options and Azure Arc-enabled Data Services. ### Source excerpt I'm super proud to announce that Ben E. Weissman and I have published SQL Server on Kubernetes - Designing and Building a Modern Data Platform available now at Apress and your favorite online book sellers! Buy the book now...or keep reading below if you need to be more convinced :) A couple of notes about the book, I saw Kubernetes showcased at a Microsoft event a few years back. I immediately saw the value and dedicated time to learning how Kubernetes and SQL Server on Kubernetes works. (Literally on the flight home I started watching training videos and researching books to read :) Since then, I have been sharing those learnings with the data and Kubernetes communities. This book is the intersection of all of that content. I genuinely believe that this will be how you will be building systems in the near future (or right now)! SQL Server on Kubernetes is the foundation for Big Data Clusters and now Azure Arc-enabled Data Services. I also want to call out my co-author and friend, Ben; you are an incredible writer and thank you for driving this book to completion! [Next page]()