Skip to content

feat: add token frequencies#438

Open
cheb0 wants to merge 1 commit into
mainfrom
0-doc-freqs
Open

feat: add token frequencies#438
cheb0 wants to merge 1 commit into
mainfrom
0-doc-freqs

Conversation

@cheb0

@cheb0 cheb0 commented Jun 11, 2026

Copy link
Copy Markdown
Collaborator

Description

Adds token frequency which can be used to optimize query performance


  • I have read and followed all requirements in CONTRIBUTING.md;
  • I used LLM/AI assistance to make this pull request;

@dkharms dkharms force-pushed the 336-merge-source branch 3 times, most recently from 50256a3 to b017111 Compare June 26, 2026 08:54
@dkharms dkharms force-pushed the 336-merge-source branch 3 times, most recently from 8917131 to 261846d Compare July 6, 2026 12:37
Base automatically changed from 336-merge-source to main July 6, 2026 12:40
@cheb0 cheb0 force-pushed the 0-doc-freqs branch 3 times, most recently from a8feb9e to 323d2ff Compare July 8, 2026 08:15
@codecov-commenter

codecov-commenter commented Jul 8, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 84.09091% with 21 lines in your changes missing coverage. Please review.
✅ Project coverage is 70.58%. Comparing base (25381c2) to head (2aad996).

Files with missing lines Patch % Lines
frac/sealed/token/block_loader.go 83.90% 7 Missing and 7 partials ⚠️
cmd/index_analyzer/main.go 0.00% 4 Missing ⚠️
indexwriter/blocks.go 80.00% 1 Missing and 1 partial ⚠️
cmd/seq-db/seq-db.go 0.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #438      +/-   ##
==========================================
+ Coverage   70.51%   70.58%   +0.06%     
==========================================
  Files         232      232              
  Lines       18268    18376     +108     
==========================================
+ Hits        12881    12970      +89     
- Misses       4426     4438      +12     
- Partials      961      968       +7     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

🔴 Performance Degradation

Some benchmarks have degraded compared to the previous run.
Click on Show table button to see full list of degraded benchmarks.

Show table
Name Previous Current Ratio Verdict
Sealing_NoSort-4 25381c 6afc04
5314.00 allocs/op 6000.00 allocs/op 1.13 🔴
Sealing_WithSort-4 25381c 6afc04
5370.00 allocs/op 6074.00 allocs/op 1.13 🔴

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

🔴 Performance Degradation

Some benchmarks have degraded compared to the previous run.
Click on Show table button to see full list of degraded benchmarks.

Show table
Name Previous Current Ratio Verdict
Sealing_NoSort-4 25381c 1d308e
5314.00 allocs/op 5977.00 allocs/op 1.12 🔴
Sealing_WithSort-4 25381c 1d308e
5370.00 allocs/op 6044.00 allocs/op 1.13 🔴

@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

🔴 Performance Degradation

Some benchmarks have degraded compared to the previous run.
Click on Show table button to see full list of degraded benchmarks.

Show table
Name Previous Current Ratio Verdict
AggDeep/size=1000000-4 25381c 8e734e
4659647.00 ns/op 5193054.00 ns/op 1.11 🔴
Not/size=10000-4 25381c 8e734e
4.51 ns/op 5.02 ns/op 1.11 🔴
Not/size=1000000-4 25381c 8e734e
4.66 ns/op 5.22 ns/op 1.12 🔴
ParseESTime/es_stdlib-4 25381c 8e734e
182.30 ns/op 204.10 ns/op 1.12 🔴
ParseESTime/handwritten-4 25381c 8e734e
39.96 ns/op 44.60 ns/op 1.12 🔴
ParseESTime/rfc3339-4 25381c 8e734e
51.37 ns/op 57.38 ns/op 1.12 🔴

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants