RECENT POSTS
- Introduction to FreeBSD Security Best Practices
- Working with Package Management in FreeBSD
- Understanding FreeBSD Security Advisories and Updates
- Troubleshooting Common System Administration Issues in FreeBSD
- Tips for Hardening FreeBSD to achieve System Protection
- Setting Up DHCP Server in FreeBSD
- Secure User and Group Management in FreeBSD Systems
- Secure Remote Access with SSH in FreeBSD
- Optimizing System Performance in FreeBSD
- Network Packet Capture with tcpdump in FreeBSD
- All posts ...
Do you have GDPR compliance issues ?
Check out Legiscope a GDPR compliance software, that will save you weeks of work, automating your documentation, the training of your teams and all processes you need to keep your organisation compliant with privacy regulations
Arrow-datafusion
Jul 20, 2023
Apache Arrow DataFusion SQL Query Engine
DataFusion is an extensible query planning, optimization, and execution framework, written in Rust, that uses Apache Arrow as its in-memory format.
Features
- SQL query planner with support for multiple SQL dialects
- DataFrame API
- Parquet, CSV, JSON, and Avro file formats are supported natively. Custom
file formats can be supported by implementing a
TableProvidertrait. - Supports popular object stores, including AWS S3, Azure Blob Storage, and Google Cloud Storage. There are extension points for implementing custom object stores.
Use Cases DataFusion is modular in design with many extension points and can be used without modification as an embedded query engine and can also provide a foundation for building new systems. Here are some example use cases
- DataFusion can be used as a SQL query planner and query optimizer, providing optimized logical plans that can then be mapped to other execution engines.
- DataFusion is used to create modern, fast and efficient data pipelines, ETL processes, and database systems, which need the performance of Rust and Apache Arrow and want to provide their users the convenience of an SQL interface or a DataFrame API.
Checkout these related ports:
- Zoneinfo - Updated timezone definitions
- Zine - Simple and opinionated tool to build your own magazine
- Ytree - DOS-XTREE(tm) look-a-like file manager
- Yaunc - Yet another uptimes.net client
- Xtypo - X-based keyboard trainer
- Xtar - View and manipulate contents of a tar file
- Xtail - Watches the growth of files or directories
- Xplr - Hackable, minimal, fast TUI file explorer
- Xosd - X11 on-screen-display program and library
- Xless - X11-based viewer for text files
- Xiphos - Bible interface utilizing the sword framework
- Xgboost - Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT, GBM)
- Xgas - The animated simulation of an ideal gas
- Xfce4-wm-themes - Additional themes for xfwm4
- Xfce4-weather-plugin - Weather plugin for the Xfce panel