Skip to main content

Getting Started

Learn how to quickly set up and use Lightfeed to extract and maintain website data.

Prerequisites​

To follow along with this documentation, you'll need:

  • An active Lightfeed account (create one here if you don't have access)
  • Basic familiarity with the websites or web data you wish to extract
  • For API integration: Generate an API key from your account settings page

Each section of this documentation includes practical examples you can implement in your own Lightfeed workspace. We recommend setting up a test database to experiment with the concepts as you learn them.

Quick Start Guide​

Follow these steps to create your first automated web data extraction:

  1. Log in to your Lightfeed account

  2. Create a new Database

    • Navigate to the "Extract" section in the sidebar
    • Click the "Create database" button in the top right

  3. Add your Sources

    • Enter the URLs for any websites you want to extract data from
    • Lightfeed supports regular websites, e-commerce stores, LinkedIn profiles, Google search results, and more

  4. Describe what you need in plain language

    • Write a natural language prompt describing what data to extract
    • Example: "Extract a list of B2B companies, including their name, description, and website. From their website, find their pricing plans and contact email."

  5. Review the automatically generated schema

    • Lightfeed creates a structured schema based on your description
    • You can adjust field names or types if needed

  6. Set up a schedule

    • Configure how often you want Lightfeed to refresh your data
    • Choose from hourly, daily, or weekly options

  7. Access your data

    • Once extraction completes, your structured data is available in your database
    • Query, filter, and export your data as needed

That's it! Your data will be automatically maintained according to your schedule, with deduplication handled for you.

Next Steps​

We will walk you through the key concepts of Lightfeed, then provide detailed instructions on mastering each feature, and finally explore integration options including our API.

Last updated on