Feat: add multiprocessing to generator

docs/14_functional_testing.md

@@ -36,6 +36,10 @@ Spikee ships with an end-to-end functional suite that exercises the CLI exactly
    - Bootstrap a scratch workspace (`spikee init`) and overlay the fixtures under `tests/functional/fixtures`.
    - Execute the relevant `spikee` CLI commands (currently `spikee generate` and `spikee test`) and assert the outputs.
 
+   Optionally, run the functional suite from your workspace `pytest ../tests/functional` to use enviromental variables from your workspace .env file:
+   - `SPIKEE_TESTS_USE_ISOLATED_VENV=1` - Uses current environment instead of creating a new one for each test session. This is useful if you have already installed spikee in your current environment and want to speed up the tests by skipping the installation step.
+   - Uses LLM provider inference keys.
+
 4. **Run a single test** (useful while debugging):
 
    ```bash

spikee/cli.py

@@ -209,7 +209,12 @@ def main():
         default=None,
         help="Include a tag at the end of the generated dataset filename",
     )
-
+    parser_generate.add_argument(
+        "--threads",
+        type=int,
+        default=1,
+        help="Number of threads for parallel plugin processing (default: 1)",
+    )
     parser_plugin = subparsers_generate.add_parser(
         "plugin", help="Apply a plugin transformation to a string"
     )
@@ -773,4 +778,4 @@ def copy_builtin_modules(include_option, force=False):
                 print(f"[init] No built-in {module_type} were copied")
 
         except Exception as e:
-            print(f"[init] Error processing {module_type}: {e}")
+            print(f"[init] Error processing {module_type}: {e}")