MySQL partitions tutorial
146 likes113,399 views
This document provides information about partitioning in MySQL 5.1 presented by Sarah Sproehnle and Giuseppe Maxia. It discusses partitioning types (range, hash, list, key), partitioning expressions, partitioning pruning, benchmarking partitions, partitioning with different storage engines, partitioning by dates, and optimizing queries on partitioned tables.
1 of 118
Downloaded 3,312 times
Ad
Recommended
MySQL partitioning
MySQL partitioning OracleMySQL This document discusses MySQL partitioning, including when and why to use partitioning, different types of partitioning, and how to manage partitions. It covers using partitioning for faster deletion of data by dropping partitions, faster queries through partition pruning, and making some operations like adding indexes faster by performing them on individual partitions rather than entire tables. It provides examples and best practices for using partitioning for both short and long term rolling of data.
Oracle sql high performance tuning
Oracle sql high performance tuningGuy Harrison This document discusses techniques for optimizing SQL performance in Oracle databases. It covers topics like optimizing the optimizer itself through configuration changes and statistics collection, detecting poorly performing SQL, and methods for improving plans such as indexing, partitioning, hints and baselines. The goal is to maximize the optimizer's accuracy and ability to handle edge cases, while also knowing how to intervene when needed to capture fugitive SQL and ensure acceptable performance.
Optimizing queries MySQL
Optimizing queries MySQLGeorgi Sotirov The document discusses optimizing queries in MySQL, including the use of explain plans to understand execution paths, the importance of indexing, and new optimization features. It emphasizes the developer's role in query performance and outlines the syntax for using explain plans, as well as the types of information they provide. Additionally, it covers topics such as optimizer hints, histograms, and the various types of indexes that can be used to improve query efficiency.
Bloat and Fragmentation in PostgreSQL
Bloat and Fragmentation in PostgreSQLMasahiko Sawada PostgreSQL uses MVCC which creates multiple versions of rows during updates and deletes. This leads to bloat and fragmentation over time as unused row versions accumulate. The VACUUM command performs garbage collection to recover space from dead rows. HOT updates and pruning help reduce bloat by avoiding index bloat during certain updates. Future improvements include parallel and eager vacuuming as well as pluggable storage engines like zheap to further reduce bloat.
SQL window functions for MySQL
SQL window functions for MySQLDag H. Wanvik The document provides an overview of SQL window functions in MySQL, explaining their functionality, types, and examples. It highlights the differences between window functions and traditional aggregate functions, emphasizing their ability to perform calculations across a set of related rows without grouping them into a single output row. Various examples illustrate the application of window specifications, including partitioning and ordering of rows, as well as optimizations related to their evaluation.
Practical Partitioning in Production with Postgres
Practical Partitioning in Production with PostgresEDB The document discusses the importance and methods of partitioning in PostgreSQL, highlighting historical improvements and practical applications. It covers partitioning techniques, including range, list, and hash methods, and outlines a step-by-step process to implement partitioning in a production environment with large tables. Key considerations such as performance, maintenance, and the selection of partition keys are also emphasized for optimizing database management.
The MySQL Query Optimizer Explained Through Optimizer Trace
The MySQL Query Optimizer Explained Through Optimizer Traceoysteing The document discusses the MySQL query optimizer. It begins by explaining how the optimizer works, including analyzing statistics, determining optimal join orders and access methods. It then describes how the optimizer trace can provide insight into why a particular execution plan was selected. The remainder of the document provides details on the various phases the optimizer goes through, including logical transformations, cost-based optimizations like range analysis and join order selection.
Advanced MySQL Query Tuning
Advanced MySQL Query TuningAlexander Rubin - The document discusses advanced techniques for optimizing MySQL queries, including topics like temporary tables, file sorting, order optimizations, and calculated fields.
- It provides examples of using indexes and index optimizations, explaining concepts like index types, index usage, key lengths, and covering indexes.
- One example shows how to optimize a query involving a calculated year() expression by rewriting the query to use a range on the date field instead.
How to Use JSON in MySQL Wrong
How to Use JSON in MySQL WrongKarwin Software Solutions LLC The document discusses using JSON in MySQL. It begins by introducing the speaker and outlining topics to be covered, including why JSON is useful, loading JSON data into MySQL, performance considerations when querying JSON data, using generated columns with JSON, and searching multi-valued attributes in JSON. The document then dives into examples demonstrating loading sample data from XML to JSON in MySQL, issues that can arise, and techniques for optimizing JSON queries using generated columns and indexes.
How does PostgreSQL work with disks: a DBA's checklist in detail. PGConf.US 2015
How does PostgreSQL work with disks: a DBA's checklist in detail. PGConf.US 2015PostgreSQL-Consulting This document discusses how PostgreSQL works with disks and provides recommendations for disk subsystem monitoring, hardware selection, and configuration tuning to optimize performance. It explains that PostgreSQL relies on disk I/O for reading pages, writing the write-ahead log (WAL), and checkpointing. It recommends monitoring disk utilization, IOPS, latency, and I/O wait. The document also provides tips for choosing hardware like SSDs or RAID configurations and configuring the operating system, file systems, and PostgreSQL to improve performance.
ProxySQL for MySQL
ProxySQL for MySQLMydbops The document provides an overview of MyDBOps, highlighting its expertise in MySQL consulting and support services, including the use of ProxySQL as an efficient load balancer for MySQL. It discusses the advantages of SQL-aware load balancers over traditional reverse proxies, detailing features such as health checks, query routing, and caching. Additionally, the document covers ProxySQL's architecture, configuration management, and monitoring capabilities, emphasizing its open-source nature and advanced functionalities for database scaling and management.
Materialized Views and Secondary Indexes in Scylla: They Are finally here!
Materialized Views and Secondary Indexes in Scylla: They Are finally here!ScyllaDB This document summarizes a presentation about materialized views, secondary indexes, and filtering in ScyllaDB. Materialized views allow querying data by non-primary key columns through automatic denormalization. Secondary indexes provide an alternative through global indexes. Filtering queries that don't use the primary key are now supported with the ALLOW FILTERING option. The presentation covered how these features work, consistency models, and combining indexes with filtering for optimized queries. Future work includes improving materialized view repair and adding selectivity statistics.
Introduction to the Mysteries of ClickHouse Replication, By Robert Hodges and...
Introduction to the Mysteries of ClickHouse Replication, By Robert Hodges and...Altinity Ltd Altinity is a leading provider of ClickHouse software and services, including enterprise support and feature development. The document outlines replication concepts, setup procedures, and operational details for managing ClickHouse clusters using Zookeeper for high availability and scaling. It emphasizes the critical aspects of replication and sharding, providing guidelines for configuration, management, and best practices.
Webinar slides: MORE secrets of ClickHouse Query Performance. By Robert Hodge...
Webinar slides: MORE secrets of ClickHouse Query Performance. By Robert Hodge...Altinity Ltd The document provides an overview of ClickHouse and techniques for optimizing performance. It discusses how the ClickHouse query log can help understand query execution and bottlenecks. Methods covered for improving performance include adding indexes, optimizing data layout through partitioning and ordering, using encodings to reduce data size, and materialized views. Storage optimizations like multi-disk volumes and tiered storage are also introduced.
AIOUG-GroundBreakers-Jul 2019 - 19c RAC
AIOUG-GroundBreakers-Jul 2019 - 19c RACSandesh Rao This document discusses troubleshooting Oracle Real Application Clusters (RAC). It begins with an overview of RAC architecture including Grid Infrastructure, CRS, ASM, and networking requirements. The document then covers various troubleshooting scenarios for issues like cluster startup failures and node evictions. It also discusses proactive and reactive monitoring tools available in Oracle RAC and recent performance improvements.
Mastering PostgreSQL Administration
Mastering PostgreSQL AdministrationEDB The document is a presentation on advanced PostgreSQL administration, covering installation, configuration, maintenance, and monitoring. It provides detailed information on server initialization, authentication methods, permissions, and configuration settings. Additionally, it addresses transaction management, query tuning, and logging best practices.
PostgreSQL Database Slides
PostgreSQL Database Slidesmetsarin This document provides an introduction and overview of PostgreSQL, including its history, features, installation, usage and SQL capabilities. It describes how to create and manipulate databases, tables, views, and how to insert, query, update and delete data. It also covers transaction management, functions, constraints and other advanced topics.
MySQL Performance Tuning: Top 10 Tips
MySQL Performance Tuning: Top 10 TipsOSSCube This document provides tips for tuning a MySQL database to optimize performance. It discusses why tuning is important for cost effectiveness, performance, and competitive advantage. It outlines who should be involved in tuning including application designers, developers, DBAs and system administrators. The document covers what can be tuned such as applications, databases structures, and hardware. It provides best practices for when and how much to tune a database. Specific tuning techniques are discussed for various areas including application development, database design, server configuration, and storage engine optimizations.
The Volcano/Cascades Optimizer
The Volcano/Cascades Optimizer宇 傅 The document describes the Volcano/Cascades query optimizer. It uses dynamic programming to efficiently search the large space of possible query execution plans. The optimizer represents queries as logical and physical operators connected by transformation and implementation rules. It explores the logical plan space and then builds physical plans by applying these rules. The search is guided by estimating physical operator costs. The optimizer memoizes partial results to avoid redundant work. This approach allows finding optimal execution plans in a principled way that scales to complex queries and optimizer extensions.
PostgreSQL Administration for System Administrators
PostgreSQL Administration for System AdministratorsCommand Prompt., Inc The document is a presentation by Spencer Christensen on PostgreSQL administration for Linux/Unix system administrators, focusing on management and monitoring aspects. It covers various topics, including creating database clusters, configuring postgresql.conf and pg_hba.conf, logging options, and tools for monitoring database performance. Key commands and examples for installation, starting/stopping the database, and managing connections are also provided.
AWR Sample Report
AWR Sample ReportDevendra Singh This document contains a workload repository report for a database named DB11G. Key details include:
- The database ran on a Linux server with 1 CPU and 1.96GB of memory.
- Between two snapshots taken an hour apart, the average wait time per session was 4.8-5.1 seconds.
- The top foreground wait event was log file sync, taking up 9.15% of database time.
How to Analyze and Tune MySQL Queries for Better Performance
How to Analyze and Tune MySQL Queries for Better Performanceoysteing The document discusses techniques for optimizing MySQL queries for better performance. It covers topics like cost-based query optimization in MySQL, selecting optimal data access methods like indexes, the join optimizer, subquery optimizations, and tools for monitoring and analyzing queries. The presentation agenda includes introductions to index selection, join optimization, subquery optimizations, ordering and aggregation, and influencing the optimizer. Examples are provided to illustrate index selection, ref access analysis, and the range optimizer.
Postgresql
PostgresqlNexThoughts Technologies PostgreSQL, an advanced open-source object-relational database, originated in 1986 and has evolved significantly through various versions, introducing numerous features like user-defined types and efficient concurrency handling through multi-version concurrency control (MVCC). Compared to MySQL, PostgreSQL offers extensive support for complex data types, JSON, and geospatial data, alongside superior compliance with SQL standards and enhanced security features. The document also details fundamental operations, permissions management, and the creation and manipulation of databases and tables in PostgreSQL.
PostgreSQL and RAM usage
PostgreSQL and RAM usageAlexey Bashtanov The document discusses PostgreSQL server processes and RAM usage, highlighting the importance of memory management to prevent issues like system crashes due to out of memory errors. It explains different server processes and their roles, including backends, writer, checkpointer, and autovacuum processes, as well as how shared memory and various configurations affect RAM consumption. Additionally, it emphasizes the need to monitor and optimize queries to handle memory effectively during execution.
Stored procedure
Stored procedurebaabtra.com - No. 1 supplier of quality freshers The document discusses stored procedures in databases. It defines stored procedures as procedures that are stored in a database with a name, parameter list, and SQL statements. The key points covered include:
- Stored procedures are created using the CREATE PROCEDURE statement and can contain SQL statements and control flow statements like IF/THEN.
- Parameters can be used to pass data into and out of stored procedures.
- Variables can be declared and used within stored procedures.
- Cursors allow stored procedures to iterate through result sets row by row to perform complex logic.
- Error handling and exceptions can be managed within stored procedures using DECLARE HANDLER.
Stored procedures offer benefits
pg_proctab: Accessing System Stats in PostgreSQL
pg_proctab: Accessing System Stats in PostgreSQLMark Wong The document discusses the use of pg_proctab, a collection of C stored functions for accessing PostgreSQL system and operating system statistics, including process activity and resource usage. It provides examples of how to query various statistics and create snapshots to monitor system performance. Additionally, it highlights the utility of pg_proctab for generating custom reports and monitoring remote databases.
Chasing the optimizer
Chasing the optimizerMauro Pagano The document discusses the optimization process of SQL queries, detailing the roles of logical and physical optimizers in generating execution plans. It emphasizes transformations applied to query blocks (QBs) for efficiency and the importance of statistical analysis in determining optimal join orders and access paths. Real-life examples illustrate the complexities of optimizing queries and advise testing and verifying any claims made regarding optimization strategies.
Boost performance with MySQL 5.1 partitions
Boost performance with MySQL 5.1 partitionsGiuseppe Maxia This document discusses using MySQL 5.1 partitions to improve performance. It begins with an introduction to Giuseppe Maxia, the presenter. It then provides an overview of MySQL partitions, explaining that they allow logical splitting of tables in a way that is transparent to users. It discusses how partitions can address issues like having too much data, not enough RAM, or needing to store and purge historical data quickly. It then demonstrates how to create partitions and discusses partitioning strategies, limitations, and when partitions should be used.
MySQL 5.1 and beyond
MySQL 5.1 and beyondGiuseppe Maxia The document details the new features and enhancements in MySQL 5.1, particularly focusing on partitions, performance improvements, and the event scheduler. It explains how table partitioning works, its advantages, and performance benchmarking results against different database engines. Additionally, it discusses the event scheduler functionality for executing SQL code at specific times and the methodology for improving overall system performance in MySQL 5.4.
More Related Content
What's hot (20)
How to Use JSON in MySQL Wrong
How to Use JSON in MySQL WrongKarwin Software Solutions LLC The document discusses using JSON in MySQL. It begins by introducing the speaker and outlining topics to be covered, including why JSON is useful, loading JSON data into MySQL, performance considerations when querying JSON data, using generated columns with JSON, and searching multi-valued attributes in JSON. The document then dives into examples demonstrating loading sample data from XML to JSON in MySQL, issues that can arise, and techniques for optimizing JSON queries using generated columns and indexes.
How does PostgreSQL work with disks: a DBA's checklist in detail. PGConf.US 2015
How does PostgreSQL work with disks: a DBA's checklist in detail. PGConf.US 2015PostgreSQL-Consulting This document discusses how PostgreSQL works with disks and provides recommendations for disk subsystem monitoring, hardware selection, and configuration tuning to optimize performance. It explains that PostgreSQL relies on disk I/O for reading pages, writing the write-ahead log (WAL), and checkpointing. It recommends monitoring disk utilization, IOPS, latency, and I/O wait. The document also provides tips for choosing hardware like SSDs or RAID configurations and configuring the operating system, file systems, and PostgreSQL to improve performance.
ProxySQL for MySQL
ProxySQL for MySQLMydbops The document provides an overview of MyDBOps, highlighting its expertise in MySQL consulting and support services, including the use of ProxySQL as an efficient load balancer for MySQL. It discusses the advantages of SQL-aware load balancers over traditional reverse proxies, detailing features such as health checks, query routing, and caching. Additionally, the document covers ProxySQL's architecture, configuration management, and monitoring capabilities, emphasizing its open-source nature and advanced functionalities for database scaling and management.
Materialized Views and Secondary Indexes in Scylla: They Are finally here!
Materialized Views and Secondary Indexes in Scylla: They Are finally here!ScyllaDB This document summarizes a presentation about materialized views, secondary indexes, and filtering in ScyllaDB. Materialized views allow querying data by non-primary key columns through automatic denormalization. Secondary indexes provide an alternative through global indexes. Filtering queries that don't use the primary key are now supported with the ALLOW FILTERING option. The presentation covered how these features work, consistency models, and combining indexes with filtering for optimized queries. Future work includes improving materialized view repair and adding selectivity statistics.
Introduction to the Mysteries of ClickHouse Replication, By Robert Hodges and...
Introduction to the Mysteries of ClickHouse Replication, By Robert Hodges and...Altinity Ltd Altinity is a leading provider of ClickHouse software and services, including enterprise support and feature development. The document outlines replication concepts, setup procedures, and operational details for managing ClickHouse clusters using Zookeeper for high availability and scaling. It emphasizes the critical aspects of replication and sharding, providing guidelines for configuration, management, and best practices.
Webinar slides: MORE secrets of ClickHouse Query Performance. By Robert Hodge...
Webinar slides: MORE secrets of ClickHouse Query Performance. By Robert Hodge...Altinity Ltd The document provides an overview of ClickHouse and techniques for optimizing performance. It discusses how the ClickHouse query log can help understand query execution and bottlenecks. Methods covered for improving performance include adding indexes, optimizing data layout through partitioning and ordering, using encodings to reduce data size, and materialized views. Storage optimizations like multi-disk volumes and tiered storage are also introduced.
AIOUG-GroundBreakers-Jul 2019 - 19c RAC
AIOUG-GroundBreakers-Jul 2019 - 19c RACSandesh Rao This document discusses troubleshooting Oracle Real Application Clusters (RAC). It begins with an overview of RAC architecture including Grid Infrastructure, CRS, ASM, and networking requirements. The document then covers various troubleshooting scenarios for issues like cluster startup failures and node evictions. It also discusses proactive and reactive monitoring tools available in Oracle RAC and recent performance improvements.
Mastering PostgreSQL Administration
Mastering PostgreSQL AdministrationEDB The document is a presentation on advanced PostgreSQL administration, covering installation, configuration, maintenance, and monitoring. It provides detailed information on server initialization, authentication methods, permissions, and configuration settings. Additionally, it addresses transaction management, query tuning, and logging best practices.
PostgreSQL Database Slides
PostgreSQL Database Slidesmetsarin This document provides an introduction and overview of PostgreSQL, including its history, features, installation, usage and SQL capabilities. It describes how to create and manipulate databases, tables, views, and how to insert, query, update and delete data. It also covers transaction management, functions, constraints and other advanced topics.
MySQL Performance Tuning: Top 10 Tips
MySQL Performance Tuning: Top 10 TipsOSSCube This document provides tips for tuning a MySQL database to optimize performance. It discusses why tuning is important for cost effectiveness, performance, and competitive advantage. It outlines who should be involved in tuning including application designers, developers, DBAs and system administrators. The document covers what can be tuned such as applications, databases structures, and hardware. It provides best practices for when and how much to tune a database. Specific tuning techniques are discussed for various areas including application development, database design, server configuration, and storage engine optimizations.
The Volcano/Cascades Optimizer
The Volcano/Cascades Optimizer宇 傅 The document describes the Volcano/Cascades query optimizer. It uses dynamic programming to efficiently search the large space of possible query execution plans. The optimizer represents queries as logical and physical operators connected by transformation and implementation rules. It explores the logical plan space and then builds physical plans by applying these rules. The search is guided by estimating physical operator costs. The optimizer memoizes partial results to avoid redundant work. This approach allows finding optimal execution plans in a principled way that scales to complex queries and optimizer extensions.
PostgreSQL Administration for System Administrators
PostgreSQL Administration for System AdministratorsCommand Prompt., Inc The document is a presentation by Spencer Christensen on PostgreSQL administration for Linux/Unix system administrators, focusing on management and monitoring aspects. It covers various topics, including creating database clusters, configuring postgresql.conf and pg_hba.conf, logging options, and tools for monitoring database performance. Key commands and examples for installation, starting/stopping the database, and managing connections are also provided.
AWR Sample Report
AWR Sample ReportDevendra Singh This document contains a workload repository report for a database named DB11G. Key details include:
- The database ran on a Linux server with 1 CPU and 1.96GB of memory.
- Between two snapshots taken an hour apart, the average wait time per session was 4.8-5.1 seconds.
- The top foreground wait event was log file sync, taking up 9.15% of database time.
How to Analyze and Tune MySQL Queries for Better Performance
How to Analyze and Tune MySQL Queries for Better Performanceoysteing The document discusses techniques for optimizing MySQL queries for better performance. It covers topics like cost-based query optimization in MySQL, selecting optimal data access methods like indexes, the join optimizer, subquery optimizations, and tools for monitoring and analyzing queries. The presentation agenda includes introductions to index selection, join optimization, subquery optimizations, ordering and aggregation, and influencing the optimizer. Examples are provided to illustrate index selection, ref access analysis, and the range optimizer.
Postgresql
PostgresqlNexThoughts Technologies PostgreSQL, an advanced open-source object-relational database, originated in 1986 and has evolved significantly through various versions, introducing numerous features like user-defined types and efficient concurrency handling through multi-version concurrency control (MVCC). Compared to MySQL, PostgreSQL offers extensive support for complex data types, JSON, and geospatial data, alongside superior compliance with SQL standards and enhanced security features. The document also details fundamental operations, permissions management, and the creation and manipulation of databases and tables in PostgreSQL.
PostgreSQL and RAM usage
PostgreSQL and RAM usageAlexey Bashtanov The document discusses PostgreSQL server processes and RAM usage, highlighting the importance of memory management to prevent issues like system crashes due to out of memory errors. It explains different server processes and their roles, including backends, writer, checkpointer, and autovacuum processes, as well as how shared memory and various configurations affect RAM consumption. Additionally, it emphasizes the need to monitor and optimize queries to handle memory effectively during execution.
Stored procedure
Stored procedurebaabtra.com - No. 1 supplier of quality freshers The document discusses stored procedures in databases. It defines stored procedures as procedures that are stored in a database with a name, parameter list, and SQL statements. The key points covered include:
- Stored procedures are created using the CREATE PROCEDURE statement and can contain SQL statements and control flow statements like IF/THEN.
- Parameters can be used to pass data into and out of stored procedures.
- Variables can be declared and used within stored procedures.
- Cursors allow stored procedures to iterate through result sets row by row to perform complex logic.
- Error handling and exceptions can be managed within stored procedures using DECLARE HANDLER.
Stored procedures offer benefits
pg_proctab: Accessing System Stats in PostgreSQL
pg_proctab: Accessing System Stats in PostgreSQLMark Wong The document discusses the use of pg_proctab, a collection of C stored functions for accessing PostgreSQL system and operating system statistics, including process activity and resource usage. It provides examples of how to query various statistics and create snapshots to monitor system performance. Additionally, it highlights the utility of pg_proctab for generating custom reports and monitoring remote databases.
Chasing the optimizer
Chasing the optimizerMauro Pagano The document discusses the optimization process of SQL queries, detailing the roles of logical and physical optimizers in generating execution plans. It emphasizes transformations applied to query blocks (QBs) for efficiency and the importance of statistical analysis in determining optimal join orders and access paths. Real-life examples illustrate the complexities of optimizing queries and advise testing and verifying any claims made regarding optimization strategies.
How does PostgreSQL work with disks: a DBA's checklist in detail. PGConf.US 2015
How does PostgreSQL work with disks: a DBA's checklist in detail. PGConf.US 2015PostgreSQL-Consulting
Similar to MySQL partitions tutorial (20)
Boost performance with MySQL 5.1 partitions
Boost performance with MySQL 5.1 partitionsGiuseppe Maxia This document discusses using MySQL 5.1 partitions to improve performance. It begins with an introduction to Giuseppe Maxia, the presenter. It then provides an overview of MySQL partitions, explaining that they allow logical splitting of tables in a way that is transparent to users. It discusses how partitions can address issues like having too much data, not enough RAM, or needing to store and purge historical data quickly. It then demonstrates how to create partitions and discusses partitioning strategies, limitations, and when partitions should be used.
MySQL 5.1 and beyond
MySQL 5.1 and beyondGiuseppe Maxia The document details the new features and enhancements in MySQL 5.1, particularly focusing on partitions, performance improvements, and the event scheduler. It explains how table partitioning works, its advantages, and performance benchmarking results against different database engines. Additionally, it discusses the event scheduler functionality for executing SQL code at specific times and the methodology for improving overall system performance in MySQL 5.4.
Partitioning Under The Hood
Partitioning Under The HoodMySQLConference Mikael Ronström and Mattias Jonsson worked on implementing and improving partitioning in MySQL. Partitioning allows tables to be broken into smaller pieces (partitions) that can improve performance by making queries faster and reducing locking overhead. The implementation involves a partitioning handler that directs queries to individual partitions while supporting pruning to avoid scanning irrelevant partitions. Future work may include moving partitions between tables and improving locking to further optimize queries on partitioned tables.
Applied Partitioning And Scaling Your Database System Presentation
Applied Partitioning And Scaling Your Database System PresentationRichard Crowley This document discusses applying partitioning to MySQL OLTP applications. It begins by reviewing classic uses of partitioning in data warehousing applications. It then explains how partitioning can benefit OLTP workloads by reducing seek and scan set sizes and limiting transaction durations. The document provides an example of applying hash partitioning to tables in a retail store application based on store ID. It demonstrates how to expand and merge partitions as stores are added or closed. Performance tests on the partitioned tables show improvements in query times compared to non-partitioned tables. In summary, the document argues that partitioning provides a way to scale MySQL databases for OLTP workloads while reducing maintenance costs.
Boost Performance With My S Q L 51 Partitions
Boost Performance With My S Q L 51 PartitionsPerconaPerformance This document discusses using MySQL 5.1 partitions to boost performance with large datasets. It begins with an introduction of the author Giuseppe Maxia. It then discusses defining problems with too much data like not enough RAM. It explains what partitions are, how to create them, and when they should be used, such as for large tables or historical data. Hands-on examples are provided using the MySQL employees test database partitioned by year. Partitions provided faster queries and deleting of records compared to non-partitioned tables. Some pitfalls and best practices are also covered.
Partitioning Tables and Indexing Them --- Article
Partitioning Tables and Indexing Them --- ArticleHemant K Chitale This document introduces the concept of table partitioning in Oracle databases, outlining its evolution and various partitioning methods, including range, hash, and list partitioning. It emphasizes the importance of selecting an appropriate partitioning strategy based on the data's nature and how partitioning can enhance database performance and maintenance. Additionally, the document provides examples and guidance on managing and maintaining partitioned tables effectively.
MySQL partitioning performance
MySQL partitioning performanceTommy Đột Giuseppe Maxia introduces MySQL 5.1 partitions as a way to logically split tables to improve performance for large datasets. Partitions allow single inserts and selects on partitioned columns to be faster, as well as range selects. Historical data can also be stored and deleted more efficiently using partitions. The document provides examples of creating partitions by range, list, hash and key and discusses use cases, limitations, and benchmark improvements seen with partitioning.
Big data mgmt bala
Big data mgmt balaMichelle Crapo Partitioning enables large tables to be divided into smaller, more manageable partitions. There are several types of partitioning including range, hash, list and interval. To implement partitioning, one identifies candidate tables, determines the partition key, generates the CREATE TABLE statement defining the partitions, and loads data into the partitioned table. Partitioning improves manageability and allows dropping partitions instead of deleting records.
Partitioning tables and indexing them
Partitioning tables and indexing them Hemant K Chitale This document discusses partitioning tables and indexing them in Oracle databases. It covers the different types of partitioning including range, list, hash, and composite partitioning. It provides examples of creating partitioned tables and indexes. It also discusses strategies for maintaining partitioned tables, including adding, dropping, splitting, merging and exchanging partitions. It recommends different partitioning and indexing approaches for optimizing query performance and archiving old data.
Partitions Performance with MySQL 5.1 and 5.5
Partitions Performance with MySQL 5.1 and 5.5Giuseppe Maxia The document discusses MySQL partitions introduced in version 5.1. It provides an overview of partitions, including what they are (logical splitting of tables), benefits (faster inserts/selects, pruning partitions), and how to implement them. Examples are given to demonstrate partition pruning for single record and range selects. Limitations and best practices are also covered, such as always querying the partition column and avoiding expressions. Benchmarks show partitions can improve performance for range queries and deleting large amounts of data.
Partition and conquer large data in PostgreSQL 10
Partition and conquer large data in PostgreSQL 10Ashutosh Bapat This document discusses declarative partitioning in PostgreSQL 10, which allows tables to be partitioned for better manageability, performance, and storage optimization. Key points include:
- Tables can be partitioned by range or list on single or multiple columns, with sub-partitioning support.
- Partitions act as independent tables that can have their own constraints, indexes, and tablespaces. Utilities can be run individually on partitions.
- Queries benefit from partition pruning, partition-wise joins and aggregations for better performance. DMLs are faster with less overhead.
Table Partitions
Table PartitionsAnar Godjaev The document discusses different types of partitioning for database tables, including range, hash, list, range-hash, and range-list partitioning. Range partitioning divides rows into partitions based on the values of a column like dates. Hash partitioning assigns rows to partitions using a hashing algorithm on a column value. List partitioning assigns rows to partitions based on an explicit list of partition values like groups of states. The examples show how to create and manage table partitions for each type of partitioning.
w_dzon05
w_dzon05Ora Weinstein The document discusses database partitioning in MySQL. It defines database partitioning as a technique that splits large databases into smaller, more manageable partitions. This improves performance, availability, and manageability. The document then covers the basics of partitioning, how it is implemented in MySQL, and the types of partitioning including horizontal, vertical, range, list, hash, and key partitioning. It also discusses managing existing partitions.
Oracle Table Partitioning - Introduction
Oracle Table Partitioning - IntroductionMyOnlineITCourses The document provides an overview of Oracle partitioning, explaining how it enables large tables or indexes to be divided into smaller and more manageable pieces for improved performance and flexibility. It discusses the benefits of partitioning, including faster query access, simplified maintenance, and easier data management strategies such as range, hash, and list partitioning. Additionally, it outlines when to partition tables, the methods for implementing different partitioning strategies, and the implications for data management.
Divide and Be Conquered?
Divide and Be Conquered?brooksaix The document discusses different ways of partitioning sales data tables in a MySQL database and compares the performance of partitioned vs non-partitioned tables. It covers partitioning sales data by date, order ID, and different engines (InnoDB vs MyISAM). The performance of queries, inserts and administrative tasks on the different partitioning schemes is evaluated. While partitioning sometimes improved performance, it also introduced overhead in some cases depending on the use case. Proper partitioning requires understanding how the data is distributed and accessed.
Partitioning
PartitioningReema Gajjar Partitioning allows tables and indexes to be subdivided into smaller pieces called partitions. Tables can be partitioned using a partition key which determines which partition each row belongs to. Partitioning provides benefits like improved query performance for large tables, easier management of historical data, and increased high availability. Some disadvantages include additional licensing costs, storage space usage, and administrative overhead to manage partitions. Common partitioning strategies include range, list, hash and interval which divide tables in different ways based on column values.
Partitioning 20061205
Partitioning 20061205Jeff Hammerbacher The document discusses partitioning in MySQL 5.1 and onwards. It describes how partitioning allows for easier maintenance and management of large tables by dividing tables into multiple smaller parts. It outlines the different types of partitioning including range, list, hash, and composite partitioning and explains how partitioning can improve query performance, data placement, and preparation for parallel queries. Finally, it provides examples of SQL statements for managing partitions through operations like adding, dropping, coalescing and reorganizing partitions.
SQL Server 2008 Performance Enhancements
SQL Server 2008 Performance Enhancementsinfusiondev This document summarizes several performance improvements introduced in SQL Server 2008 including partitioning enhancements, sparse columns, filtered indexes, plan freezing, and the MERGE statement. It provides information on how each feature works and example use cases.
MySQL Partitioning 5.6
MySQL Partitioning 5.6Mark Swarbrick This document discusses MySQL partitioning, including how it splits tables into pieces based on row values, the internal handling by the partitioning engine, and new features in version 5.6. It provides details on the types of partitioning (range, list, hash, key), how partitioning improves performance and manageability, and how operations like adding, dropping, and reorganizing partitions are implemented.
Partitioning Design
Partitioning DesignMartin Cairns This document discusses different types of database partitioning including horizontal, vertical, and file group partitioning. It provides examples and definitions of each type. Key benefits highlighted include improved performance through better query plans, reduced backup sizes, and ability to do partial database restores for high availability. The document also discusses considerations for determining good candidates for partitioning and demonstrates partitioning techniques.
Ad
More from Giuseppe Maxia (20)
MySQL NDB 8.0 clusters in your laptop with dbdeployer
MySQL NDB 8.0 clusters in your laptop with dbdeployerGiuseppe Maxia - dbdeployer is a command line tool that allows users to quickly deploy and manage MySQL and MySQL Cluster (NDB) databases across multiple nodes.
- It can install single MySQL sandboxes, master-slave replication clusters, and MySQL Cluster configurations with 3 or more nodes.
- When deploying a MySQL Cluster, dbdeployer automatically generates configuration files, starts the NDB management and data nodes, and then starts the MySQL nodes to connect to the cluster. This simplifies setting up test and development environments for MySQL Cluster.
Test like a_boss
Test like a_bossGiuseppe Maxia The document discusses dbdeployer, a command line tool for deploying and testing MySQL database topologies. It can deploy single or multiple MySQL instances, as well as complex topologies like replication, group replication, and multi-source replication with a single command. Dbdeployer aims to make deploying and testing databases fast and easy by avoiding repetitive manual tasks. It has features for upgrading and importing existing databases.
Dbdeployer, the universal installer
Dbdeployer, the universal installerGiuseppe Maxia Giuseppe Maxia presents dbdeployer, a command line tool for deploying MySQL sandboxes. Dbdeployer allows for easy installation of single server, replication, and cluster topologies of various MySQL technologies. It supports versions from MySQL 5.0 to 8.0. Dbdeployer installations are isolated, have no dependencies, and allow customization. The tool handles tasks like listing install options, deploying sandboxes, managing operations, and removing installations.
Test complex database systems in your laptop with dbdeployer
Test complex database systems in your laptop with dbdeployerGiuseppe Maxia Giuseppe Maxia is a software explorer at VMware who has created several tools for MySQL over the decades, including MySQL-Sandbox. He rewrote MySQL-Sandbox in Go to create a new tool called dbdeployer. Dbdeployer allows users to easily install, configure, and manage isolated MySQL sandboxes on their local machine without dependencies. It provides functionality for single server, replication, and group replication deployments through an intuitive command line interface. The tool handles tasks like port allocation and initialization automatically to simplify the sandbox development workflow.
Dbdeployer
DbdeployerGiuseppe Maxia Este documento presenta dbdeployer, una herramienta desarrollada en Go por Giuseppe Maxia para instalar y administrar sandboxes de MySQL de manera sencilla. Dbdeployer mejora sobre la herramienta anterior MySQL-Sandbox de Maxia al eliminar dependencias y hacer más fácil la instalación. Dbdeployer permite instalar sandboxes individuales, múltiples o con replicación de varias topologías de manera automática. La herramienta es de código abierto y el autor invita contribuciones para seguir mejorándola.
Dbdeployer
DbdeployerGiuseppe Maxia This document introduces dbdeployer, a tool written in Go that allows users to easily deploy and manage MySQL sandboxes. It summarizes the key features and capabilities of dbdeployer, including installing single or replicated sandboxes, customizing configurations, finding free ports, and exposing various MySQL 8 data dictionary tables. The document provides instructions on downloading, unpacking, and using dbdeployer to deploy different types of MySQL configurations for testing or development purposes.
A quick tour of Mysql 8 roles
A quick tour of Mysql 8 rolesGiuseppe Maxia This document provides an overview of roles in MySQL 8.0, including:
- Roles were introduced in MySQL 8.0 to simplify user administration and centralize privilege handling. Roles are created and granted like users but do not require login credentials.
- The key aspects of using roles are: creating roles, granting privileges to roles, creating users, granting roles to users, and setting the default role for users.
- Roles simplify administration but also introduce some complexity, such as roles being stored as users without logins and the need to set a default role for a user's privileges to take effect. The document provides examples and best practices for working with roles.
MySQL document_store
MySQL document_storeGiuseppe Maxia This document discusses using MySQL as a document store by introducing the MySQL X-Protocol and associated tools. Key points include:
- The MySQL X-Plugin and MySQL Shell allow MySQL to function as a document store, uniting SQL and NoSQL approaches.
- The X-Protocol extends the traditional client/server protocol to enable asynchronous communication and a universal API for different languages.
- While the document store feature is available in MySQL 5.7.12+, the associated tools are still in early development stages and not production ready.
- Examples demonstrate using the MySQL Shell to work with document collections, perform CRUD operations, and convert data between MySQL, MongoDB, and JSON formats in a schema-less manner
Replication skeptic
Replication skepticGiuseppe Maxia MySQL and MariaDB implementations of multi-source replication allow a slave server to replicate from multiple master servers simultaneously. MySQL 5.7 introduced multi-source replication using new CHANNEL syntax for CHANGE MASTER, SHOW SLAVE STATUS, and START/STOP SLAVE commands. MariaDB 10 implemented it similarly with new CHANNEL syntax. Both require global transaction identifiers and crash-safe tables to be enabled. Monitoring information is now split into separate records for each master in SHOW SLAVE STATUS.
Synchronise your data between MySQL and MongoDB
Synchronise your data between MySQL and MongoDBGiuseppe Maxia The document discusses synchronizing data between MySQL and MongoDB using Tungsten Replicator. Tungsten Replicator allows data to be replicated from a MySQL database to MongoDB in near real-time. The document provides examples of data being inserted and updated in MySQL, and then appearing in MongoDB through the replication process. It also discusses security features and how to install Tungsten Replicator for basic master-slave replication between MySQL and MongoDB databases.
Juggle your data with Tungsten Replicator
Juggle your data with Tungsten ReplicatorGiuseppe Maxia The document provides an overview of Continuent's Tungsten Replicator, highlighting its clustering and replication capabilities for open-source DBMS, particularly MySQL. It details installation processes, including different replication topologies such as master/slave, bi-directional, and multi-master installations, as well as the added security features for data encryption. Key installation commands and configurations are presented for various setups and use cases within the Tungsten ecosystem.
MySQL in your laptop
MySQL in your laptopGiuseppe Maxia This document discusses MySQL Sandbox, a tool for quickly installing and testing multiple MySQL database servers on a single machine. The tool allows users to install MySQL servers from binaries in seconds, set up replication topologies easily, and customize server configurations. MySQL Sandbox provides an easy way to test MySQL features without having to manually configure each database instance.
Script it
Script itGiuseppe Maxia This document provides tips and examples for creating shell scripts to automate database administration tasks. It recommends using shell scripts because shell is available everywhere and shell scripting is powerful and fast to write. It then provides several tips for writing robust shell scripts, such as using configuration files, running commands in parallel, and creating shortcuts. The document includes examples of scripts for installing MySQL replication across multiple servers and testing that replication is working.
Tungsten Replicator tutorial
Tungsten Replicator tutorialGiuseppe Maxia The document discusses Tungsten Replicator, an open source replication engine. It provides an overview of Tungsten Replicator's capabilities including supporting multiple masters and heterogeneous replication topologies. It then discusses requirements for installation and demonstrates installing Tungsten Replicator in a master-slave configuration across four virtual machines using the Tungsten cookbook installation scripts.
Preventing multi master conflicts with tungsten
Preventing multi master conflicts with tungstenGiuseppe Maxia The document discusses multi-master replication using Continuent Tungsten and how it prevents data conflicts. It describes how Tungsten allows defining rules to specify which database can be updated by each master node. Tungsten then enforces these rules on slave nodes to prevent "unknown" or "unwanted" shards from being updated, which could lead to data duplication, inconsistency, loss or break replication. Examples are provided showing how conflict prevention works in different replication topologies.
MySQL high availability power and usability
MySQL high availability power and usabilityGiuseppe Maxia Giuseppe Maxia presents on MySQL high availability using Continuent Tungsten. He discusses how Tungsten provides transparency and ease of use for database users by enabling features like easy and automated failover between database servers. It allows applications to continue working without changes even during a failover. Tungsten also makes it easy to manage high availability across multiple database sites. The presentation covers how Tungsten installations work and demonstrates high availability configurations for both single and multiple sites.
Solving MySQL replication problems with Tungsten
Solving MySQL replication problems with TungstenGiuseppe Maxia This document provides an overview and introduction to using Tungsten Replicator to solve replication problems. It discusses Tungsten Replicator concepts and components, how to plan, install, and configure Tungsten Replicator in different topologies such as master-slave, all-masters, and fan-in. It also covers common administration tasks like monitoring replication, managing the replication process, and using tools like trepctl and thl.
State of the art of MySQL replication and clustering
State of the art of MySQL replication and clusteringGiuseppe Maxia This document discusses high availability and replication solutions for MySQL databases. It introduces Continuent, a provider of clustering and replication software for MySQL. Continuent's product, Tungsten, provides commercial-grade high availability, performance scaling, and data management for MySQL. Tungsten Replicator allows for flexible, high-performance data replication. The document then discusses various Continuent solutions that can enable future-proofed high availability and replication architectures for MySQL databases.
Testing mysql creatively in a sandbox
Testing mysql creatively in a sandboxGiuseppe Maxia This document discusses using MySQL Sandbox, a tool that allows quickly installing and configuring multiple MySQL database servers for testing purposes using a simple command line interface. Key points:
- MySQL Sandbox can install MySQL servers in seconds using a single command, much faster than manual installation.
- It supports configurations like replication between multiple servers for testing replication scenarios.
- Pre-packaged scripts are provided to easily start, stop, and manage sandboxes. Custom scripts can also be created to automate testing workflows.
- Various options allow customizing server configurations like ports, data directories, and replication topologies in a reproducible manner.
Mysql 5.5 and 5.6 replication
Mysql 5.5 and 5.6 replicationGiuseppe Maxia The document discusses new features in MySQL replication in versions 5.5 and 5.6, including:
1) Semi-synchronous replication which helps ensure that data is replicated to at least one slave;
2) Delayed replication which allows transactions to be delayed on the slave for a specified time period; and
3) Features in 5.6 such as server UUID, crash-safe slave using replication tables, multi-threaded slave, and global transaction identifiers.
Ad
Recently uploaded (20)
PyData - Graph Theory for Multi-Agent Integration
PyData - Graph Theory for Multi-Agent Integrationbarqawicloud Graph theory is a well-known concept for algorithms and can be used to orchestrate the building of multi-model pipelines. By translating tasks and dependencies into a Directed Acyclic Graph, we can orchestrate diverse AI models, including NLP, vision, and recommendation capabilities. This tutorial provides a step-by-step approach to designing graph-based AI model pipelines, focusing on clinical use cases from the field.
Providing an OGC API Processes REST Interface for FME Flow
Providing an OGC API Processes REST Interface for FME FlowSafe Software This presentation will showcase an adapter for FME Flow that provides REST endpoints for FME Workspaces following the OGC API Processes specification. The implementation delivers robust, user-friendly API endpoints, including standardized methods for parameter provision. Additionally, it enhances security and user management by supporting OAuth2 authentication. Join us to discover how these advancements can elevate your enterprise integration workflows and ensure seamless, secure interactions with FME Flow.
Can We Use Rust to Develop Extensions for PostgreSQL? (POSETTE: An Event for ...
Can We Use Rust to Develop Extensions for PostgreSQL? (POSETTE: An Event for ...NTT DATA Technology & Innovation Can We Use Rust to Develop Extensions for PostgreSQL?
(POSETTE: An Event for Postgres 2025)
June 11, 2025
Shinya Kato
NTT DATA Japan Corporation
TrustArc Webinar - 2025 Global Privacy Survey
TrustArc Webinar - 2025 Global Privacy SurveyTrustArc How does your privacy program compare to your peers? What challenges are privacy teams tackling and prioritizing in 2025?
In the sixth annual Global Privacy Benchmarks Survey, we asked global privacy professionals and business executives to share their perspectives on privacy inside and outside their organizations. The annual report provides a 360-degree view of various industries' priorities, attitudes, and trends. See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar features an expert panel discussion and data-driven insights to help you navigate the shifting privacy landscape. Whether you are a privacy officer, legal professional, compliance specialist, or security expert, this session will provide actionable takeaways to strengthen your privacy strategy.
This webinar will review:
- The emerging trends in data protection, compliance, and risk
- The top challenges for privacy leaders, practitioners, and organizations in 2025
- The impact of evolving regulations and the crossroads with new technology, like AI
Predictions for the future of privacy in 2025 and beyond
Data Validation and System Interoperability
Data Validation and System InteroperabilitySafe Software A non-profit human services agency with specialized health record and billing systems. Challenges solved include access control integrations from employee electronic HR records, multiple regulations compliance, data migrations, benefits enrollments, payroll processing, and automated reporting for business intelligence and analysis.
FIDO Seminar: Targeting Trust: The Future of Identity in the Workforce.pptx
FIDO Seminar: Targeting Trust: The Future of Identity in the Workforce.pptxFIDO Alliance FIDO Seminar: Targeting Trust: The Future of Identity in the Workforce
Edge-banding-machines-edgeteq-s-200-en-.pdf
Edge-banding-machines-edgeteq-s-200-en-.pdfAmirStern2 מכונת קנטים המתאימה לנגריות קטנות או גדולות (כמכונת גיבוי).
מדביקה קנטים מגליל או פסים, עד עובי קנט – 3 מ"מ ועובי חומר עד 40 מ"מ. בקר ממוחשב המתריע על תקלות, ומנועים מאסיביים תעשייתיים כמו במכונות הגדולות.
Scaling GenAI Inference From Prototype to Production: Real-World Lessons in S...
Scaling GenAI Inference From Prototype to Production: Real-World Lessons in S...Anish Kumar Presented by: Anish Kumar
LinkedIn: https://www.linkedin.com/in/anishkumar/
This lightning talk dives into real-world GenAI projects that scaled from prototype to production using Databricks’ fully managed tools. Facing cost and time constraints, we leveraged four key Databricks features—Workflows, Model Serving, Serverless Compute, and Notebooks—to build an AI inference pipeline processing millions of documents (text and audiobooks).
This approach enables rapid experimentation, easy tuning of GenAI prompts and compute settings, seamless data iteration and efficient quality testing—allowing Data Scientists and Engineers to collaborate effectively. Learn how to design modular, parameterized notebooks that run concurrently, manage dependencies and accelerate AI-driven insights.
Whether you're optimizing AI inference, automating complex data workflows or architecting next-gen serverless AI systems, this session delivers actionable strategies to maximize performance while keeping costs low.
Floods in Valencia: Two FME-Powered Stories of Data Resilience
Floods in Valencia: Two FME-Powered Stories of Data ResilienceSafe Software In October 2024, the Spanish region of Valencia faced severe flooding that underscored the critical need for accessible and actionable data. This presentation will explore two innovative use cases where FME facilitated data integration and availability during the crisis. The first case demonstrates how FME was used to process and convert satellite imagery and other geospatial data into formats tailored for rapid analysis by emergency teams. The second case delves into making human mobility data—collected from mobile phone signals—accessible as source-destination matrices, offering key insights into population movements during and after the flooding. These stories highlight how FME's powerful capabilities can bridge the gap between raw data and decision-making, fostering resilience and preparedness in the face of natural disasters. Attendees will gain practical insights into how FME can support crisis management and urban planning in a changing climate.
Reducing Conflicts and Increasing Safety Along the Cycling Networks of East-F...
Reducing Conflicts and Increasing Safety Along the Cycling Networks of East-F...Safe Software In partnership with the Belgian Province of East-Flanders this project aimed to reduce conflicts and increase safety along a cycling route between the cities of Oudenaarde and Ghent. To achieve this goal, the current cycling network data needed some extra key information, including: Speed limits for segments, Access restrictions for different users (pedestrians, cyclists, motor vehicles, etc.), Priority rules at intersections. Using a 360° camera and GPS mounted on a measuring bicycle, we collected images of traffic signs and ground markings along the cycling lanes building up mobile mapping data. Image recognition technologies identified the road signs, creating a dataset with their locations and codes. The data processing entailed three FME workspaces. These included identifying valid intersections with other networks (e.g., roads, railways), creating a topological network between segments and intersections and linking road signs to segments and intersections based on proximity and orientation. Additional features, such as speed zones, inheritance of speed and access to neighbouring segments were also implemented to further enhance the data. The final results were visualized in ArcGIS, enabling analysis for the end users. The project provided them with key insights, including statistics on accessible road segments, speed limits, and intersection priorities. These will make the cycling paths more safe and uniform, by reducing conflicts between users.
War_And_Cyber_3_Years_Of_Struggle_And_Lessons_For_Global_Security.pdf
War_And_Cyber_3_Years_Of_Struggle_And_Lessons_For_Global_Security.pdfbiswajitbanerjee38 Russia is one of the most aggressive nations when it comes to state coordinated cyberattacks — and Ukraine has been at the center of their crosshairs for 3 years. This report, provided the State Service of Special Communications and Information Protection of Ukraine contains an incredible amount of cybersecurity insights, showcasing the coordinated aggressive cyberwarfare campaigns of Russia against Ukraine.
It brings to the forefront that understanding your adversary, especially an aggressive nation state, is important for cyber defense. Knowing their motivations, capabilities, and tactics becomes an advantage when allocating resources for maximum impact.
Intelligence shows Russia is on a cyber rampage, leveraging FSB, SVR, and GRU resources to professionally target Ukraine’s critical infrastructures, military, and international diplomacy support efforts.
The number of total incidents against Ukraine, originating from Russia, has steadily increased from 1350 in 2021 to 4315 in 2024, but the number of actual critical incidents has been managed down from a high of 1048 in 2022 to a mere 59 in 2024 — showcasing how the rapid detection and response to cyberattacks has been impacted by Ukraine’s improved cyber resilience.
Even against a much larger adversary, Ukraine is showcasing outstanding cybersecurity, enabled by strong strategies and sound tactics. There are lessons to learn for any enterprise that could potentially be targeted by aggressive nation states.
Definitely worth the read!
Introduction to Typescript - GDG On Campus EUE
Introduction to Typescript - GDG On Campus EUEGoogle Developer Group On Campus European Universities in Egypt Interested in leveling up your JavaScript skills? Join us for our Introduction to TypeScript workshop.
Learn how TypeScript can improve your code with dynamic typing, better tooling, and cleaner architecture. Whether you're a beginner or have some experience with JavaScript, this session will give you a solid foundation in TypeScript and how to integrate it into your projects.
Workshop content:
- What is TypeScript?
- What is the problem with JavaScript?
- Why TypeScript is the solution
- Coding demo
June Patch Tuesday
June Patch TuesdayIvanti Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.
Enabling BIM / GIS integrations with Other Systems with FME
Enabling BIM / GIS integrations with Other Systems with FMESafe Software Jacobs has successfully utilized FME to tackle the complexities of integrating diverse data sources in a confidential $1 billion campus improvement project. The project aimed to create a comprehensive digital twin by merging Building Information Modeling (BIM) data, Construction Operations Building Information Exchange (COBie) data, and various other data sources into a unified Geographic Information System (GIS) platform. The challenge lay in the disparate nature of these data sources, which were siloed and incompatible with each other, hindering efficient data management and decision-making processes.
To address this, Jacobs leveraged FME to automate the extraction, transformation, and loading (ETL) of data between ArcGIS Indoors and IBM Maximo. This process ensured accurate transfer of maintainable asset and work order data, creating a comprehensive 2D and 3D representation of the campus for Facility Management. FME's server capabilities enabled real-time updates and synchronization between ArcGIS Indoors and Maximo, facilitating automatic updates of asset information and work orders. Additionally, Survey123 forms allowed field personnel to capture and submit data directly from their mobile devices, triggering FME workflows via webhooks for real-time data updates. This seamless integration has significantly enhanced data management, improved decision-making processes, and ensured data consistency across the project lifecycle.
Supporting the NextGen 911 Digital Transformation with FME
Supporting the NextGen 911 Digital Transformation with FMESafe Software Next Generation 911 involves the transformation of our 911 system from an old analog one to the new digital internet based architecture. The evolution of NG911 opens up a host of new opportunities to improve the system. This includes everything from device based location, to real time text. This can improve location accuracy dramatically as well as provide live updates from the citizen in need along with real time sensor updates. There is also the opportunity to provide multi-media attachments and medical records if the end user approves. This digital transformation and enhancements all require the support of new NENA and CRTC standards, along with integration across a variety of data streams.
This presentation will focus on how FME has supported NG911 transformations to date, and how we are positioning FME to support the enhanced capabilities to come. This session will be of interest to emergency services, municipalities and anyone who may be interested to know more about how emergency services are being improved to provide more accurate, localized information in order to improve the speed and relevance of emergency response and ultimately save more lives and provide better outcomes for those in need.
FME for Distribution & Transmission Integrity Management Program (DIMP & TIMP)
FME for Distribution & Transmission Integrity Management Program (DIMP & TIMP)Safe Software Peoples Gas in Chicago, IL has changed to a new Distribution & Transmission Integrity Management Program (DIMP & TIMP) software provider in recent years. In order to successfully deploy the new software we have created a series of ETL processes using FME Form to transform our gas facility data to meet the required DIMP & TIMP data specifications. This presentation will provide an overview of how we used FME to transform data from ESRI’s Utility Network and several other internal and external sources to meet the strict data specifications for the DIMP and TIMP software solutions.
Bridging the divide: A conversation on tariffs today in the book industry - T...
Bridging the divide: A conversation on tariffs today in the book industry - T...BookNet Canada A collaboration-focused conversation on the recently imposed US and Canadian tariffs where speakers shared insights into the current legislative landscape, ongoing advocacy efforts, and recommended next steps. This event was presented in partnership with the Book Industry Study Group.
Link to accompanying resource: https://bnctechforum.ca/sessions/bridging-the-divide-a-conversation-on-tariffs-today-in-the-book-industry/
Presented by BookNet Canada and the Book Industry Study Group on May 29, 2025 with support from the Department of Canadian Heritage.
FME for Good: Integrating Multiple Data Sources with APIs to Support Local Ch...
FME for Good: Integrating Multiple Data Sources with APIs to Support Local Ch...Safe Software Have-a-skate-with-Bob (HASB-KC) is a local charity that holds two Hockey Tournaments every year to raise money in the fight against Pancreatic Cancer. The FME Form software is used to integrate and exchange data via API, between Google Forms, Google Sheets, Stripe payments, SmartWaiver, and the GoDaddy email marketing tools to build a grass-roots Customer Relationship Management (CRM) system for the charity. The CRM is used to communicate effectively and readily with the participants of the hockey events and most importantly the local area sponsors of the event. Communication consists of a BLOG used to inform participants of event details including, the ever-important team rosters. Funds raised by these events are used to support families in the local area to fight cancer and support PanCan research efforts to find a cure against this insidious disease. FME Form removes the tedium and error-prone manual ETL processes against these systems into 1 or 2 workbenches that put the data needed at the fingertips of the event organizers daily freeing them to work on outreach and marketing of the events in the community.
The State of Web3 Industry- Industry Report
The State of Web3 Industry- Industry ReportLiveplex Web3 is poised for mainstream integration by 2030, with decentralized applications potentially reaching billions of users through improved scalability, user-friendly wallets, and regulatory clarity. Many forecasts project trillions of dollars in tokenized assets by 2030 , integration of AI, IoT, and Web3 (e.g. autonomous agents and decentralized physical infrastructure), and the possible emergence of global interoperability standards. Key challenges going forward include ensuring security at scale, preserving decentralization principles under regulatory oversight, and demonstrating tangible consumer value to sustain adoption beyond speculative cycles.
Can We Use Rust to Develop Extensions for PostgreSQL? (POSETTE: An Event for ...
Can We Use Rust to Develop Extensions for PostgreSQL? (POSETTE: An Event for ...NTT DATA Technology & Innovation
Introduction to Typescript - GDG On Campus EUE
Introduction to Typescript - GDG On Campus EUEGoogle Developer Group On Campus European Universities in Egypt