questdb/questdb
 Watch   
 Star   
 Fork   
24 days ago
questdb

7.4.2

What's Changed

New Contributors

Full Changelog: https://github.com/questdb/questdb/compare/7.4.0...7.4.2

24 days ago
questdb

7.4.1

What's Changed

New Contributors

Full Changelog: https://github.com/questdb/questdb/compare/7.4.0...7.4.1

2024-03-23 01:05:49
questdb

7.4.0

🌸 QuestDB 7.4 Release Notes

Ahh, Spring! Sunshine, flowers, all that nice stuff.

As the wheels of the seasons turn, so to the wheels of the applications we're all busy building.

Hopefully good things bloom for us all.

QuestDB is pleased to release version 7.4!

As you've come to expect, this release further improves core database performance. Also as per usual, several bugs and rough edges have been addressed. In important addition, there are note-able breaking changes that will provide a smoother overall experience and set us up well for future changes. Please address them prior to upgrade, and reach out to us if you run into any issues.

⚠️ New Features with breaking changes

  • SAMPLE BY queries now use ALIGN TO CALENDAR by default. As such, if you're using SAMPLE BY and expecting ALIGN TO FIRST OBSERVATION, you'll need to update your queries to specify that syntax.

  • Java client: The ILP Sender used in our first-party Java client now requires an explicit selection of Transport, (HTTP or TCP) for enhanced reliability and clarity in data ingestion workflows. You will need to pass this value forward. See the PR for more information. If you do not use the Java client, but use another language client, see your respective language client repository and update if needed.

  • CREATE TABLE AS and INSERT INTO SELECT statements now operate non-atomically and are batched by default. If you require an atomic table, you can now use the very powerful sounding: CREATE ATOMIC TABLE.

🚀 Performance Improvements

This release improves parallel GROUP BY query performance and also makes SAMPLE BY queries more efficient. In addition, we've reduced thread-local allocator overhead in single-threaded GROUP BY & SAMPLE BY queries. The first/last aggregate functions for string columns have also been optimized.

🐛 Bug Fixes

  • Resolved issues leading to segmentation faults and incorrect results in certain SQL queries involving GROUP BY and SAMPLE BY clauses.
  • Addressed a bug that could cause a table to be omitted from snapshots after significant DDL changes.
  • Fixed HTTP request handling to prevent rejections when content-length is set to 0.
  • Solved potential TLS handshake stalls on MacOS.
  • Corrected the behavior of altering tables to add indexes that could inadvertently remove deduplication keys.
  • Eliminated a crash during ingestion and various other stability issues.

What's Changed

New Contributors

Full Changelog: https://github.com/questdb/questdb/compare/7.3.10...7.3.11

2024-02-23 02:19:27
questdb

7.3.10

Fresh from QuestDB 🐲

The 2024 Lunar New Year marks the Year of the Dragon. 🐉 When you think of the mighty dragon, what comes to mind? For us, well, we're a little different. Dragons evoke strength, wisdom, and - naturally - wild performance (we're performance obsessed).

Within that theme, the 7.3.10 release offers a 5x-10x speed-up in ASOF and LT JOIN queries, as well as a number of optimizations in parallel filters, GROUP BY, and within the JIT compiler. Further, UUID and LONG256 columns are now supported by parallel GROUP BY for efficient use of all hardware resources. For workloads that feature small, but frequent transactions you'll also see improved performance.

Familiar with InfluxDB? Interested in using InfluxDB Line Protocol (ILP), but with something more robust under-the-hood? This release provides 5x faster ingestion performance when multiple connections are in use, further increasing overall throughput strength compared to InfluxDB, especially in data with high cardinality. Whether you're looking to leverage ILP for high performance streaming, or upgrading an existing InfluxDB workload over to QuestDB, this update makes it easier.

Read more about "drop-in" InfluxDB migration in our recent blog.

Alongside the usual battery of bug fixes, this release also includes a new HyperLogLog-based approx_count_distinct() SQL function that is 3x-5x faster and more memory efficient than the existing count_distinct() function for high cardinality data sets. And finally, Write-Ahead Log (WAL) enabled tables are now the default table type. This means that the benefits of WAL & WAL-required features like deduplication are available to each newly created table.

Whether you're new to QuestDB, working in prod, or migrating existing time series workloads, this release has something for you.

Performance improvements

New features

Fixes and other improvements

New Contributors

Full Changelog: https://github.com/questdb/questdb/compare/7.3.9...7.3.10

2024-01-06 01:44:15
questdb

7.3.8b

Welcome back from the holidays! (If you had one...)

In the latest QuestDB release, we've focused on enhanced stability and introduced two innovative features, currently in beta. Notably, we've improved GROUP BY performance tenfold through parallel SQL executions and introduced InfluxDB Line Protocol (ILP) support over HTTP, which is compatible with existing InfluxDB drivers. Those familiar with ILP will find a clean entryway into QuestDB.

Thanks to @ssharaev and @pompeiifreckles for their first contributions - we appreciate you.

Dive in to explore the release in detail. 🤿

What's changed

Please note that the following features are in beta - please let us know if you run into any issues.

  • 10x GROUP BY performance improvement via parallel SQL executions. Should you encounter any problems with this implementation, you can safely disabled [cairo.sql.parallel.groupby.enabled=false] it via configuration without downgrading the database instance.
  • InfluxDB Line Protocol (ILP) support over HTTP. This implementation supports existing InfluxDB drivers and eases the transition into QuestDB for existing ILP users. The new client has control over transaction boundaries and will offer helpful feedback on transaction activity. We're also pleased to offer no noticeable performance impact in ingestions performance compared to our TCP implementation.

New features

Fixes and improvements

New Contributors

Full Changelog: https://github.com/questdb/questdb/compare/7.3.7...7.3.8b

2023-12-08 01:21:29
questdb

7.3.7

What's Changed

The hits keep comin'. Newly released QuestDB 7.3.7 adds supporting functions to pair with our recently released window functions. It also offers brings further improvements to SQL and ingestion performance - this has been a pattern of late!

Additional key features include:

  • A 5x speed up of WAL Apply for small transactions
  • New built-in functions for covariance, correlation, cumulative sum, and first value window
  • Enhanced compatibility with Grafana

Thanks to @AjCH1 and @ksankeerth for their first contributions!

New features

Fixes and improvements

New Contributors

Full Changelog: https://github.com/questdb/questdb/compare/7.3.5...7.3.7

2023-12-07 23:43:10
questdb

7.3.6

What's Changed

Release highlights are new window functions and SQL and ingestion performance improvements.

New features

Fixes and improvements

New Contributors

Full Changelog: https://github.com/questdb/questdb/compare/7.3.5...7.3.6

2023-11-25 02:17:59
questdb

7.3.5

What's Changed

Following up our recent 7.3.4 release which provided Window Functions, Web Console improvements, and more, we're pleased to announce another significant release. Headlining 7.3.5 are the following key additions:

  • Percentile function: Find an approximate percentile for a given series with approx_percentile(DD).
  • Optimized queries: QuestDB has long stood out for its high performance ingestion. Not be left behind, queries also keep getting faster. In benchmarks, recent performance optimizations have shown 50% improvement to several query types.

New features

Fixes and improvements

2023-11-08 04:59:54
questdb

7.3.4

What's Changed

Better. Faster. Stronger. And even more good looking. 😎

Highlighting our latest release:

  • Window functions. These flexible functions provide moving averages, running totals, or Top-N results within a group, and more via a "window", defined by an OFFSET against a RANGE or ROWS. Unlike aggregate functions, window functions do not cause rows to become grouped into a single output row — the rows retain their separate identities. Additional perks? Performance and an easing of query complexity.

  • More functions. We've added:first(boolean), last(boolean), first(string), last(string), mathematical exponent exp(D) and first_not_null(), last_not_null(), which operate on most nullable data types, except IPv4 and GeoHash.

  • Performance. Our goal is top performance. LIKE/ILIKE queries now perform over 80% faster.

  • Web Console Refresh. The best tools provide the help that you need without getting in your way. We've tuned the Web Console UI to put what you need closer to where you need it. Less used UI elements have had their significance reduced and overall navigation has been streamlined. On top of that, a discrete news feed will send you all the latest, so that you don't miss a beat.

Before:

Screenshot 2023-11-07 at 1 00 40 PM

After:

web-console-after

New features

UI

Improvements and bug fixes

Documentation

New Contributors

Full Changelog: https://github.com/questdb/questdb/compare/7.3.3...7.3.4

2023-10-07 02:24:32
questdb

7.3.3

Overview

Thanks for all who contributed to our most recent release.

This release provides a set of stability fixes and usability improvements.

We are excited to highlight the following areas:

  • Improved operations: A trio of features including improved snapshots to replace existing backup functionality, connection count gauge metrics and a new mkdir.mode for detached partitions make QuestDB easier to operate.

  • InfluxDB Line Protocol improvements: The InfluxDB Line Protocol is commonly used for rapid ingest. We’ve made it better, by introducing more flexible and less error prone timestamps. In addition, it also authenticates faster and disconnects on error when using WAL tables.

  • New aggregate functions: Thanks to community member @charlespnh QuestDB now offers variance(), var_samp() and var_pop(), stddev(), stddev_pop() functions.

What is new

CORE

SQL

ILP

What is fixed

CORE

SQL

ILP

HTTP

PGWire

New Contributors

Full Changelog: https://github.com/questdb/questdb/compare/7.3.2...7.3.3