Skip to content

You're not viewing the latest version. Click here to go to latest.

chunklet-py Documentation

processors

Initializing search

Welcome
Getting Started
Supported Languages
Exceptions and Warnings
What's New
Migration Guide
Troubleshooting
API Reference

chunklet-py Documentation

Welcome
Getting Started
Getting Started
- Installation
- CLI
- Metadata
- Programmatic Usage
  Programmatic Usage
Supported Languages
Exceptions and Warnings
What's New
Migration Guide
Troubleshooting
API Reference
API Reference
- chunklet
  chunklet
  - cli
  - code_chunker
    
    code_chunker
    
    code_chunker
    
    helpers
    
    patterns
  - common
    
    common
    
    batch_runner
    
    path_utils
    
    token_utils
    
    validation
  - document_chunker
    
    document_chunker
    
    converters
    
    converters
    
    html_2_md
    
    latex_2_md
    
    rst_2_md
    
    document_chunker
    
    processors
    
    processors
    
    base_processor
    
    docx_processor
    
    epub_processor
    
    pdf_processor
    
    registry
  - exceptions
  - plain_text_chunker
  - sentence_splitter
    
    sentence_splitter
    
    _fallback_splitter
    
    languages
    
    registry
    
    sentence_splitter
    
    terminators

chunklet.document_chunker.processors

Modules:

base_processor –
docx_processor –
epub_processor –
pdf_processor –

document_chunker

Made with Material for MkDocs