Skip to content

This is an experimental demo repository of agent on data cleaning task

Notifications You must be signed in to change notification settings

sfu-db/CleanAgent

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CleanAgent: Automatically Standardize Your Data with LLM-based Agents

Introduction

CleanAgent is a tool that automates the data standardization process with LLM-based Agents. You only need to upload the table that needs to be standardized, and CleanAgent will get your hands free, standardize your data automatically and return the standardized table to you. Our demo paper CleanAgent: Automating Data Standardization with LLM-based Agents will be published in the future.

If you think this small project is interesting or helpful to you, please considering give us a star 🌟 🌟 🌟 ! 😃

Usage

Please use CleanAgent with the following commands:

git clone https://github.com/sfu-db/CleanAgent
cd CleanAgent
conda create -n cleanagent python=3.10.6
conda activate
export OPENAI_API_KEY="Your_Openai_API_Key"
pip install -r requirements.txt
chainlit run main.py

Then you can see the web UI of CleanAgent on http://localhost:8000

Demonstration

You also can watch the following 4-mins demo to learn how to use CleanAgent:

Citation

If you think CleanAgent is useful for you, please considering to cite our CleanAgent:

@article{qi2024cleanagent,
  title={CleanAgent: Automating Data Standardization with LLM-based Agents},
  author={Qi, Danrui and Wang, Jiannan},
  journal={arXiv preprint arXiv:2403.08291},
  year={2024}
}

About

This is an experimental demo repository of agent on data cleaning task

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages