anvie / lamdam

Language Model Dataset Manager

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Lamdam

Lamdam

Lamdam (Language Model Dataset Manager) is a web UI tool designed to facilitate the easy management of datasets for LLM (Language Model) training. Built with Next.js 13, NextUI, and Tailwind, Lamdam offers a user-friendly interface with powerful features to streamline dataset management tasks.

Features

  • User-friendly Interface: Lamdam provides an intuitive and easy-to-use interface for managing datasets, allowing users to effortlessly organize and manipulate their data.
  • Dataset Management: Easily upload, delete, and update datasets with Lamdam. The tool offers seamless navigation and a smooth data management workflow.
  • Fast Search: Quickly navigate through vast amounts of data.
  • Duplicate & Modify Record: Use existing data to build more variative data.
  • User Role Management: Manage user roles and permissions. Track user activity and view revision history.
  • Export & Import: You can export or import dataset into json format.
  • Revision History: View the modifications to the data and who made them (soon).

Requirements

Installation

To get started with Lamdam, follow the steps below:

  1. Clone the repository:

    git clone https://github.com/anvie/lamdam.git
    
  2. Change into the project directory:

    cd lamdam
    
  3. Install project dependencies:

    yarn install
    
  4. (Optional) If you want to use Approval Mode, Set this in your .env file:

    ADMIN_EMAIL="superuser@xxx.com"
    NEXT_PUBLIC_APPROVAL_MODE=true
    

    Then run this script below to create the superuser and add default pending status to existing Record(s):

    yarn db:populate
    
  5. Start the development server:

    yarn dev
    
  6. Access Lamdam in your web browser:

    http://localhost:3000
    

Contributing

Contributions to Lamdam are always welcome. If you find a bug or have a suggestion for a new feature, please open an issue on the GitHub repository.

To contribute code to Lamdam, follow these steps:

  1. Fork the repository.

  2. Create a new branch:

    git checkout -b feature/your-feature-name
    
  3. Add and commit your changes:

    git add .
    git commit -m "Added your feature"
    
  4. Push your changes to your fork:

    git push origin feature/your-feature-name
    
  5. Open a pull request on the GitHub repository.

License

Lamdam is released under the MIT License. See the LICENSE file for more details.

Acknowledgements

Lamdam was built using the following technologies:

We would like to express our gratitude to all the contributors of these projects for making Lamdam possible.

Contact

For further information or inquiries, please contact me at @anvie.

License

Licensed under the MIT license.

About

Language Model Dataset Manager

License:MIT License


Languages

Language:TypeScript 93.3%Language:JavaScript 6.1%Language:CSS 0.5%Language:Shell 0.2%