Turning 6,837 n8n Workflows Into an Automation Pattern Library and Generator
This Python project analyzes thousands of n8n marketplace workflows, turns the results into training data, and documents a path to natural-language workflow generation.
A practical question behind a large workflow corpus
Automation builders rarely start with a blank canvas because they lack ideas. More often, the hard part is knowing which integrations, control-flow steps, and workflow shapes are common enough to be useful, and which are merely interesting one-offs.
MuLIAICHI-n8n-what-the-hell-is-everyone-building is an attempt to make that landscape inspectable. The repository describes a Python-based suite that collects n8n marketplace workflows, analyzes their patterns, prepares machine-learning training examples, and supports a workflow generator that accepts natural-language requests.
n8n is a workflow-automation tool whose workflows are assembled from nodes: discrete steps such as receiving a trigger, calling an API, transforming data, or branching on a condition. For someone planning an integration, a corpus of existing workflow structures can be more actionable than a list of product features. This project is aimed at that gap: n8n users looking for patterns, developers studying integrations, and ML practitioners who want structured examples for workflow-oriented generation.
From collection to analysis to generation
The documented pipeline begins with marketplace collection. The repository identifies n8n_workflow_scraper.py as the scraper and says it supports pagination and rate limiting. Collected material is organized under n8n_data/, with separate raw, analysis, processed, and training-data directories.
Next comes analysis. n8n_workflow_analyzer.py and advanced_analysis.py are described as tools for examining nodes, categories, pricing, complexity, creators, and popularity measures. The README reports analysis of 6,837 workflows. Its reported summary is notable less as a universal statement about automation than as a snapshot of the dataset: HTTP Request appears in 73% of workflows; 32% include AI-related integrations such as OpenAI, Claude, or LangChain; and the average workflow has 8.5 nodes.
Those observations point to an especially useful implementation lesson. The dominant building block is not a highly specialized connector but the general-purpose HTTP request. In practice, that means a workflow-pattern catalog should not only recommend named integrations. It should also teach builders where generic API calls, lightweight data transformation, and conditional routing fill the gaps between those integrations.
The project then converts collected examples into training formats. It documents more than 4,000 examples in Alpaca-style JSON, OpenAI JSONL, and a simpler JSON form. The sample representation pairs an instruction such as creating an AI email assistant with a structured result containing node types, node count, and categories. That is a deliberately narrower target than emitting a fully configured production automation: it captures a workflow’s rough shape and its components.
Finally, the README describes a fine-tuned model and a Gradio web application. The intended interaction is straightforward: describe an automation in plain English, generate JSON, review it, and import it into n8n. The project also links to a hosted app, a model, a dataset, and an Apify actor for on-demand collection and analytics.
What the components contribute
The repository metadata identifies Python as the primary language. Its README documents the rest of the stack across several layers:
- Requests handles API calls for collection.
- Pandas supports data processing, while Matplotlib and Seaborn are used for visualizations.
- Apify SDK and Docker are listed for the production-facing analyzer.
- Transformers, PEFT, and Unsloth support the model fine-tuning workflow. PEFT, or parameter-efficient fine-tuning, is a technique for adapting a large model without updating every model parameter; the README specifically describes LoRA fine-tuning.
- Gradio provides the interface for the generator app, with PyTorch and Transformers supporting model inference.
The README describes the model as a 4-bit-quantized Llama 3 8B model trained on 1,283 curated examples. Quantization reduces the precision used to represent model values, usually making models more practical to load and run with constrained memory. The repository’s example output is a compact workflow description: Telegram trigger, OpenAI chat model, then Telegram. It is not a claim that every generated artifact is ready to deploy without review.
That distinction matters. A generated workflow skeleton can accelerate discovery, but imported automation can interact with accounts, APIs, and production data. Builders should treat the output as a draft: validate node settings, credentials, error paths, data mappings, and permissions before relying on it.
Useful lessons in the documented approach
One strength here is that the project keeps the dataset and the analytical layer visible alongside the generator. That makes it possible to work backward: inspect observed patterns, decide which ones suit a particular use case, and only then use generated JSON as a starting point. For research and education, that is more transparent than presenting a text-to-workflow model as a black box.
The README also records a model-selection tradeoff. It says an initial Mistral 7B fine-tuning attempt overfit. Training loss fell near zero while outputs became unusable. The Llama 3 8B approach then produced the reported valid outputs. The concrete takeaway is not that one family will always outperform another. It is that training loss alone is insufficient for structured-generation work. Sample outputs must be tested for usable structure and task fit.
There is a second tradeoff in the project’s breadth. The same repository spans scraping, analytics, dataset preparation, fine-tuning guidance, and an application. That breadth gives builders several entry points: run the analysis locally, use the linked resources, or study the training setup. It also means each layer deserves independent scrutiny when adapting it, especially the freshness and representativeness of scraped marketplace data, which the supplied evidence does not independently evaluate.
A starting point for evidence-led automation design
For n8n users, the immediate value is a way to look for recurring workflow patterns before building. For ML engineers, it is a documented example of reshaping workflow metadata into instruction-and-output training examples. And for developers, it highlights a pragmatic progression from data collection to analysis to assisted generation.
Inspect the code, documented pipeline, and linked resources in the verified repository: MuLIAICHI/MuLIAICHI-n8n-what-the-hell-is-everyone-building.
Turn your GitHub repository into a story worth sharing.
Connect a public repository, generate a reviewable draft, and publish it with Reather.
