Benchmarks

Performance benchmarks comparing DBX against other embedded databases.

Table of contents

  1. Executive Summary
    1. Latest Benchmark Results (v0.0.6-beta, 10,000 records)
    2. Performance vs Competitors
  2. Test Environment
    1. Hardware Specifications
    2. Software Environment
  3. Tested Databases
  4. Benchmark Methodology
    1. Measurement Framework
    2. Fair Comparison Conditions
      1. DBX Configuration
      2. Common Settings for All Databases
  5. Detailed Benchmark Results
    1. INSERT Performance (10,000 records)
    2. GET Performance (10,000 records)
    3. SCAN Performance (10,000 records)
  6. Performance Optimization Techniques
    1. Phase 1: GET Optimization (+70% improvement)
    2. Phase 2: SCAN Optimization (+57% improvement)
  7. Architecture Strengths
    1. 5-Tier Hybrid Storage
  8. Reproducing Benchmarks
  9. Conclusion
    1. Key Achievements
    2. Technical Differentiators
  10. Next Steps

Executive Summary

DBX is a high-performance embedded database engine written in pure Rust. v0.0.6-beta achieved 1st place in all major operations (INSERT, GET, SCAN).

Latest Benchmark Results (v0.0.6-beta, 10,000 records)

Operation DBX SQLite Sled Redb Rank
INSERT 44.92ms 🥇 53.06ms 60.56ms 54.05ms 1st
GET 2.84ms 🥇 37.39ms 5.88ms 3.25ms 1st
SCAN 1.60ms 🥇 2.98ms 4.64ms 2.15ms 1st

Performance vs Competitors

vs SQLite:

  • INSERT: 18% faster
  • GET: 1,217% faster (13x)
  • SCAN: 86% faster

vs Redb:

  • INSERT: 20% faster
  • GET: 14% faster
  • SCAN: 34% faster

vs Sled:

  • INSERT: 35% faster
  • GET: 107% faster (2x)
  • SCAN: 190% faster (2.9x)

Version: DBX v0.0.6-beta
Test Date: February 16, 2026
Report Type: Official Performance Comparison Analysis

Test Environment

Hardware Specifications

Item Specification
Operating System Microsoft Windows 11 Pro (Build 26200)
System Type x64-based PC
Processor 1 Processor (Multiprocessor Free)
Memory 16,273 MB (approx. 16GB)

Software Environment

Component Version
Rust Compiler rustc 1.92.0 (ded5c06cf 2025-12-08)
Cargo 1.92.0 (344c4567c 2025-10-21)
Build Profile release (optimizations enabled)
Benchmark Framework Criterion.rs v0.5

Tested Databases

Database Version Language Features
DBX 0.0.6-beta Pure Rust 5-Tier Hybrid Storage, MVCC
SQLite 0.32 (rusqlite) C (bundled) Industry-standard embedded DB
Sled 0.34 Pure Rust Lock-free B+ tree
Redb 2.1 Pure Rust LMDB-inspired, file-only

Benchmark Methodology

Measurement Framework

  • Tool: Criterion.rs v0.5 (Rust standard benchmarking library)
  • Sample Count: 100 iterations per test
  • Warmup: 3-second warmup before each test
  • Statistical Analysis: Mean, standard deviation, 95% confidence interval
  • Outlier Detection: Automatic outlier removal and reporting

Fair Comparison Conditions

DBX Configuration 

// Default features enabled
features = ["wal", "mvcc", "index"]

// Durability disabled for fair comparison
durability = DurabilityLevel::None

Common Settings for All Databases

  1. Transaction/Batch Mode
    • Fair comparison using batch commits instead of individual INSERTs
    • DBX: begin() → insert() × N → commit()
    • SQLite: unchecked_transaction() → execute() × N → commit()
    • Sled: insert() × N → flush()
    • Redb: begin_write() → insert() × N → commit()
  2. WAL (Write-Ahead Logging) Disabled
    • DBX: durability = DurabilityLevel::None
    • SQLite: PRAGMA synchronous = OFF
    • Sled: Default settings (flush-based)
    • Redb: Default settings (transaction-based)
  3. Identical Data Size
    • Key: String format "key_{i}"
    • Value: String format "value_data_{i}"
    • Test size: 10,000 records

Detailed Benchmark Results

INSERT Performance (10,000 records)

Database Average Time Std Dev Throughput (rec/sec) vs DBX
DBX 44.92ms ±0.20ms 222,619 1.0× (baseline)
SQLite 53.06ms ±0.38ms 188,465 0.85× (18% slower)
Redb 54.05ms ±0.72ms 185,015 0.83× (20% slower)
Sled 60.56ms ±1.55ms 165,123 0.74× (35% slower)

DBX Advantages:

  • ✅ Faster than all competitors
  • ✅ 18% faster than SQLite
  • ✅ Stable performance (low std dev)

GET Performance (10,000 records)

Database Average Time Std Dev Throughput (rec/sec) vs DBX
DBX 2.84ms ±0.01ms 3,521,127 1.0× (baseline)
Redb 3.25ms ±0.17ms 3,076,923 0.87× (14% slower)
Sled 5.88ms ±0.03ms 1,700,680 0.48× (107% slower)
SQLite 37.39ms ±0.48ms 267,452 0.08× (1,217% slower)

DBX Advantages:

  • ✅ 13x faster than SQLite
  • ✅ 14% faster than Redb
  • ✅ 2x faster than Sled

SCAN Performance (10,000 records)

Database Average Time Std Dev Throughput (rec/sec) vs DBX
DBX 1.60ms ±0.07ms 6,250,000 1.0× (baseline)
Redb 2.15ms ±0.02ms 4,651,163 0.74× (34% slower)
SQLite 2.98ms ±0.16ms 3,355,705 0.54× (86% slower)
Sled 4.64ms ±0.10ms 2,155,172 0.34× (190% slower)

DBX Advantages:

  • ✅ Faster than all competitors
  • ✅ 34% faster than Redb
  • ✅ 86% faster than SQLite

Performance Optimization Techniques

Phase 1: GET Optimization (+70% improvement)

  1. Inline Attributes
    • Added #[inline(always)] to eliminate function call overhead
    • Improved compiler optimization
  2. MVCC Overhead Removal
    • Removed MVCC checks from hot path
    • Eliminated unnecessary timestamp acquisition cost
  3. Code Path Simplification
    • Removed conditionals for better branch prediction
    • Improved CPU pipeline efficiency

Result: 9.63ms → 2.84ms (3.4x faster)

Phase 2: SCAN Optimization (+57% improvement)

  1. Delta Store Fast-path
    • Early return when Delta is empty
    • Eliminated unnecessary scan operations
  2. 2-way Merge Optimization
    • Direct WOS scan when Delta is empty
    • Completely removed merge overhead
  3. Cache Locality Improvement
    • Optimized memory access pattern with single scan
    • Improved CPU cache efficiency

Result: 3.70ms → 1.60ms (2.3x faster)

Architecture Strengths

5-Tier Hybrid Storage

  1. Delta Store (Tier 1)
    • DashMap + SkipMap (Lock-free)
    • Ultra-fast INSERT performance
  2. WOS (Tier 2)
    • BTreeMap (sorted storage)
    • Efficient range scans
  3. Optimized Data Flow
    • Automatic Delta → WOS flush
    • Efficient utilization of memory and disk

Reproducing Benchmarks 

# Clone project
git clone https://github.com/ByteLogicCore/DBX.git
cd DBX

# Run full comparison benchmark
cargo bench --bench official_db_comparison

# Run individual database benchmarks
cargo bench --bench official_db_comparison -- dbx_
cargo bench --bench official_db_comparison -- sqlite_
cargo bench --bench official_db_comparison -- sled_
cargo bench --bench official_db_comparison -- redb_

Conclusion

DBX v0.0.6-beta achieved 1st place in all major operations (INSERT, GET, SCAN).

Key Achievements

  • ✅ INSERT 1st: 44.92ms (18-35% faster than competitors)
  • ✅ GET 1st: 2.84ms (13x faster than SQLite)
  • ✅ SCAN 1st: 1.60ms (34-190% faster than competitors)

Technical Differentiators

  1. 5-Tier Hybrid Storage: Efficient utilization of memory and disk
  2. Lock-Free Architecture: DashMap + SkipMap
  3. Pure Rust: Memory safety and zero-cost abstractions
  4. Optimized Algorithms: Fast-path and inline optimizations

DBX is the optimal choice for applications requiring high-performance write workloads and balanced read/write performance.

Next Steps

Copyright © 2026 ByteLogicCore. MIT OR Apache-2.0 License.

This site uses Just the Docs, a documentation theme for Jekyll.