Introducing webhooks & web scrapers

Web scrapers and webhooks are now available on Eden AI workflow.

These tools available on workflow nodes enabling you to streamline data acquisition and create more efficient, automated workflows.

Web scrapers

Effortlessly extract structured data from websites to integrate into your workflows:

• Dynamic data extraction: specify target elements with URL and scrape real-time content from any website;
• Seamless RAG integration: directly pipeline scraped data to RAG system;

Webhooks

Webhooks enable event-driven communication between Eden AI workflows and external systems:

• Event triggers: activate workflows upon external events, such as data uploads or API responses;
• Bidirectional integration: send or receive data via incoming and outgoing webhooks;
• Third-party connectivity: easily connect external services;

Code snippet for workflow webhook:

import requests

headers = {"Authorization": "Bearer {api_key}"}

url = "https://api.edenai.run/v2/workflow/{workflow_id}/execution/"
files = {"video":open('/path/to/your/video.ext', 'rb')} 
payload = {
    "webhook_receiver": "https://webhook.site/fbfc569c-0cad-4e67-8c9f-019f78ab2ff7",
    "users_webhook_parameters": {"something": "an_id"}, 
    "send_webhook_data": true // this means to send full body or not
}
response = requests.post(url, files=files, data=payload, headers=headers)
result = response.json()

The addition of web scrapers and webhooks to Eden AI empowers developers with powerful tools for automating data workflows and enhancing AI integrations.

As always, feel free to reach out with feedback or questions. I’m here to help you make the most of Eden AI.

Samy, CTO @Eden AI