transformers_tasks
Free⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.
About transformers_tasks
A collection of NLP algorithms and tasks implemented using the Hugging Face Transformers library, covering text classification, text generation, information extraction, text matching, and advanced techniques like RLHF and SFT.
Key Features
Pros & Cons
- Open-source and free to use
- Covers a wide range of NLP tasks out of the box
- Built on the popular and well-supported Hugging Face Transformers library
- Includes modern fine-tuning approaches like RLHF
- Requires understanding of Transformers and NLP concepts
- Can be resource-intensive, often needing GPU for training and inference
- Documentation may be limited if primarily from community sources
Best For
Alternatives to transformers_tasks
CDial-GPT
A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models
ChatLM-mini-Chinese
中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调，给出三元组信息抽取微调示例。
Chat-Haruhi-Suzumiya
Chat凉宫春日, An open sourced Role-Playing chatbot Cheng Li, Ziang Leng, and others.
DialoGPT
Large-scale pretraining for dialogue
GPT2-Chinese
Chinese version of GPT2 training code, using BERT tokenizer.
gpt-2-simple
Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts