This week in Databend #26
Databend aimed to be an open source elastic and reliable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.
Big changes
Below is a list of some major changes that we don't want you to miss.
Features
- add bloom filter for single column equivalent expression by @junli1026 (#3887)
- Jwt Auth for http handler by @youngsofun (#3993)
Improvement
- add partitions_scanned and partitions_total to planner statistics by @BohuTANG. (#3909)
- clean up metasrv code and test by @drmingdrmer. (#3925, #3928 and more)
- improve
SHOW FUNCTIONSby @lianghanzhen. (#3945) - async mysql server by @PsiACE. (#3981)
Bug fixes
- support escape
\t\nfor field_delimitor & record_delimitor by @sundy-li. (#3923) - fix pruning get error when expression is not monotonic by @zhyass. (#3940)
- parallel import data error by @dantengsky. (#3964)
Experimental
- new processor framework by @zhang2014. (#3380).
- dal2: implement SeekableReader by @Xuanwo. (#3934).
Another key plan is that we are migrating functions to the new datavalues2 and if you are interested, you can track #3967 , which is a list of tasks.
Tips
Let's learn a weekly tip from Databend.
Analyze OnTime datasets with Databend on AWS EC2 and S3
Now, databend.rs has a learning section and will be followed by short lessons to help you understand how to use Databend better.
This article provides step-by-step instructions on how to deploy Databend on EC2 and S3 and perform analysis on the OnTime dataset.
Reporting Carrier On-Time Performance (1987-present)contains on-time arrival and departure data for non-stop domestic flights by month and year, by carrier and by origin and destination airport. Includes scheduled and actual departure and arrival times, canceled and diverted flights, taxi-out and taxi-in times, causes of delay and cancellation, air time, and non-stop distance.
Changlogs
You can check the changelogs of Databend nightly to learn about our latest developments.
- v0.6.45-nightly
- v0.6.44-nightly
- v0.6.43-nightly
- v0.6.42-nightly
- v0.6.41-nightly
- v0.6.40-nightly
- v0.6.39-nightly
Ecosystem/Upstream
From open source, for open source. Our team is also committed to contributing to the Rust ecosystem and upstream dependencies.
- sqllogictest-rs #15: runner: Implement validator support by @Xuanwo.
- datafuse-extras/msql-srv #18: Try async: add a simple async srv implementation. by @PsiACE.
Meet Us
Please join the DatafuseLabs Community if you are interested in Databend.
We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects.
If you are a hacker passionate about database internals, feel free to play with our code.
You can submit issues for any problems you find. We also highly appreciate any of your pull requests.
