adding more ehanced nodes via AI tools

Author: laserpilot

README.md

@@ -39,10 +39,49 @@ All files are output to the `dist` directory.
 
 ## Submitting updates
 
-You are welcome to submit your own changes to this! The easiest method is to use the page either on github pages or built locally switch to the JSON editor and then make a change to the entry or child node you want to change. If you switch back, you will see the update reflected. 
+You are welcome to submit your own changes to this! There are several ways to contribute:
+
+### Manual Editing
+The easiest method is to use the page either on github pages or built locally switch to the JSON editor and then make a change to the entry or child node you want to change. If you switch back, you will see the update reflected. 
 
 You can then press the "Download JSON" button on the Interaction panel. You can then clone or fork the repo, replace the existing `Creative_Tech_Taxonomy_data.json` file and submit it as a pull request to have it reflected in the main page.
 
+### AI-Assisted Content Enhancement
+For bulk content improvements, we have an AI-powered enhancement system that can efficiently add descriptions and links to nodes that need them:
+
+#### Prerequisites
+1. Install Python dependencies: `pip install anthropic`
+2. Set your Claude API key: `export ANTHROPIC_API_KEY="your-api-key"`
+
+#### Enhancement Workflow
+```bash
+# 1. Analyze current state and identify nodes needing improvement
+python enhance.py analyze
+
+# 2. Generate an efficient processing plan 
+python enhance.py plan
+
+# 3. Process multiple batches automatically (recommended)
+python enhance.py batch 5
+
+# OR process individual batches manually
+python enhance.py single sample_batch_for_api.json
+
+# Clean up backup files if needed
+python enhance.py cleanup
+```
+
+#### Key Features
+- **10x efficiency**: Processes batches of related nodes instead of individual API calls
+- **Source file updates**: Modifies the individual taxonomy files (not just the compiled version)
+- **Smart backup system**: Creates single backup files (not timestamped duplicates)
+- **Auto-rebuild**: Automatically rebuilds the main taxonomy file after changes
+- **Progress tracking**: Shows exactly what was enhanced and which files were modified
+
+The enhancement system only updates nodes that actually need improvement (missing descriptions or links) and preserves existing quality content.
+
+**Note**: All enhancement utility scripts are organized in the `utilities/` directory. The main `enhance.py` script provides a convenient interface to access them.
+
 ## Multiple Language Support
 
 This also now supports multiple languages! In addition to English, we have some preliminary entries for Japanese in a few spots. To add additional languages, you have to make updates in a few key spots:

enhance.py

@@ -0,0 +1,59 @@
+#!/usr/bin/env python3
+"""
+Main enhancement script - convenient entry point for AI-assisted content enhancement.
+"""
+
+import sys
+import subprocess
+from pathlib import Path
+
+def main():
+    """Main enhancement workflow."""
+    if len(sys.argv) < 2:
+        print("Creative Tech Taxonomy AI Enhancement Tools")
+        print("==========================================")
+        print()
+        print("Usage:")
+        print("  python enhance.py analyze          # Analyze current state")
+        print("  python enhance.py plan             # Generate processing plan") 
+        print("  python enhance.py batch [N]        # Process N batches (default: 5)")
+        print("  python enhance.py single <file>    # Process single batch file")
+        print("  python enhance.py cleanup          # Clean up backup files")
+        print()
+        print("Examples:")
+        print("  python enhance.py analyze")
+        print("  python enhance.py batch 3")
+        print("  python enhance.py single sample_batch_for_api.json")
+        return
+    
+    command = sys.argv[1].lower()
+    utilities_dir = Path("utilities")
+    
+    if command == "analyze":
+        subprocess.run([sys.executable, utilities_dir / "analyze_nodes.py"])
+        
+    elif command == "plan":
+        subprocess.run([sys.executable, utilities_dir / "efficient_enhance.py"])
+        
+    elif command == "batch":
+        max_batches = int(sys.argv[2]) if len(sys.argv) > 2 else 5
+        subprocess.run([sys.executable, utilities_dir / "batch_process.py", 
+                       "--max-batches", str(max_batches)])
+        
+    elif command == "single":
+        if len(sys.argv) < 3:
+            print("Error: Please specify batch file")
+            print("Usage: python enhance.py single <batch_file>")
+            return
+        batch_file = sys.argv[2]
+        subprocess.run([sys.executable, utilities_dir / "apply_enhancements.py", batch_file])
+        
+    elif command == "cleanup":
+        subprocess.run([sys.executable, utilities_dir / "auto_cleanup.py"])
+        
+    else:
+        print(f"Unknown command: {command}")
+        print("Run 'python enhance.py' for usage help")
+
+if __name__ == "__main__":
+    main()