Simplify media processing workflow - direct markdown generation

🎯 Simplified Approach:
- Remove intermediate JSON processing step
- Direct markdown generation from URLs
- Users can edit final markdown files directly

✨ Enhanced Features Retained:
- YouTube video support (title, channel, thumbnail)
- Duplicate prevention (won't overwrite existing files)
- Smart metadata extraction with validation
- Proper fallback handling

🗑️ Removed:
- extractMediaMetadata.js (intermediate JSON extraction)
- generateMediaFromJson.js (JSON to markdown conversion)
- Complex two-step workflow

💡 User Experience:
- Single command generates markdown directly
- Edit markdown files manually if needed
- Simpler workflow with same powerful features
- Clear tips in console output about direct editing

Author: pendulating

.github/workflows/content-automation.yml

@@ -84,10 +84,8 @@ jobs:
       - name: Generate media from press URLs
         if: steps.changes.outputs.press_changed == 'true'
         run: |
-          echo "Running media extraction from press.txt..."
-          node src/scripts/extractMediaMetadata.js
-          echo "Generating markdown from extracted metadata..."
-          node src/scripts/generateMediaFromJson.js
+          echo "Running media generation from press.txt..."
+          node src/scripts/generateMediaMd.js
 
       - name: Generate videos from YouTube URLs
         if: steps.changes.outputs.videos_changed == 'true'
@@ -118,9 +116,6 @@ jobs:
           git add src/content/media/
           git add src/content/videos/
           
-          # Add intermediate metadata files for manual editing
-          git add press-metadata.json
-          
           # Create descriptive commit message
           COMMIT_MSG="Auto-generate content from updated files"
           

README.md

@@ -57,7 +57,7 @@ This website includes GitHub Actions automation that automatically generates con
 | File | Generates | Script Used | Content Location |
 |------|-----------|-------------|------------------|
 | `dois.txt` | Publications | `bulkImportPublications.js` | `src/content/publications/` |
-| `press.txt` | Media mentions | `extractMediaMetadata.js` → `generateMediaFromJson.js` | `src/content/media/` |
+| `press.txt` | Media mentions | `generateMediaMd.js` | `src/content/media/` |
 | `videos.txt` | Video content | `generateVideosMd.js` | `src/content/videos/` |
 
 #### 🚀 Quick Usage
@@ -92,42 +92,33 @@ You can also run the scripts manually:
 # Generate publications from DOIs
 node src/scripts/bulkImportPublications.js dois.txt
 
-# Generate media from press URLs (two-step process)
-node src/scripts/extractMediaMetadata.js    # Creates press-metadata.json
-node src/scripts/generateMediaFromJson.js   # Generates markdown from JSON
+# Generate media from press URLs  
+node src/scripts/generateMediaMd.js
 
 # Generate videos from YouTube URLs
 node src/scripts/generateVideosMd.js
 ```
 
 #### 📝 Enhanced Media Processing
 
-The media processing uses a **two-step workflow** for better quality control:
-
-1. **Extract Metadata** (`extractMediaMetadata.js`): 
-   - Processes URLs from `press.txt`
-   - Creates `press-metadata.json` with extracted metadata
-   - Supports both **web articles** and **YouTube videos**
-   - Identifies entries that need manual review
-
-2. **Generate Markdown** (`generateMediaFromJson.js`):
-   - Reads from `press-metadata.json` 
-   - Generates final markdown files
-   - Preserves manual edits to the JSON file
-
-**Benefits:**
-- ✅ **Manual editing**: Edit `press-metadata.json` to fix titles, dates, descriptions
-- ✅ **YouTube support**: Extracts video title, channel name, thumbnail
-- ✅ **Duplicate prevention**: Won't reprocess URLs unless forced
-- ✅ **Quality indicators**: Flags entries needing manual review
-- ✅ **Incremental updates**: Only processes new URLs
-
-**Editing Workflow:**
-1. Add URLs to `press.txt` and commit
-2. Automation creates/updates `press-metadata.json`
-3. **Manually edit the JSON file** if needed (fix dates, titles, etc.)
-4. Commit the JSON changes
-5. Automation regenerates markdown files
+The media processing includes enhanced features:
+
+**✨ Features:**
+- ✅ **YouTube support**: Handles YouTube videos alongside web articles
+- ✅ **Duplicate prevention**: Won't recreate existing files
+- ✅ **Smart extraction**: Gets title, description, publish date, author
+- ✅ **Direct editing**: Edit the generated markdown files directly
+
+**🎯 YouTube Support:**
+- Extracts video title, channel name, and thumbnail
+- Adds `youtubeId`, `channelName`, and `thumbnailUrl` fields
+- Includes note about manual date verification (YouTube oEmbed doesn't provide publish dates)
+
+**✏️ Manual Editing:**
+- Generated markdown files can be edited directly
+- Fix titles, dates, descriptions, or add project associations
+- Changes persist - existing files won't be overwritten
+- Add content below the frontmatter as needed
 
 #### 🔧 Advanced Options