Lilac

Lilac is an open-source tool that enables data and AI practitioners to improve their products by improving their data. It allows users to search, quantify, and edit data for LLMs. Lilac provides features like semantic and keyword search, editing and comparing fields, PII detection, duplicate identification, language detection, custom signal integration, and fuzzy-concept search with refinement.

How to Use

To get started with Lilac, install it using pip: pip install lilac. Then, use the Python User Interface to interact with your data.

Key Features

• Semantic & keyword search
• Edit & compare fields
• PII, duplicates, language detection, or custom signal
• Fuzzy-concept search with refinement
• Blazing fast dataset computations
• Clustering and titling of large datasets
• Embedding datasets at high token rates
• Accelerating data transformations

Use Cases

• Data exploration and quality control
• Evaluating datasets
• Democratizing data across an organization
• Understanding concepts in datasets
• Selecting the right data for a task
• Determining topics covered in datasets