Extracting Enriched Product Knowledge Graphs from Product Hunt into Neo4j
Learn how to build a Hypermode Agent that extracts product data from Product Hunt, enriches it with LinkedIn insights, and stores it as a knowledge graph in Neo4j
In this tutorial, you’ll learn how to build a Hypermode Agent that automatically
extracts product data from Product Hunt, enriches it with LinkedIn insights, and
stores it as a knowledge graph in Neo4j. This powerful combination allows you to
visualize relationships between products, founders, companies, and market
trends.
Hypermode Agents are domain specific AI-powered assistants
created with natural language instructions that can understand instructions,
interact with external services, and perform complex tasks on your behalf.
Unlike traditional chatbots, Hypermode Agents can actually take actions—like
scraping websites, querying databases, and transforming data.
Neo4j is a graph database that stores data as nodes (entities) and relationships
(connections between entities). Unlike traditional databases that use tables and
rows, Neo4j excels at representing and querying interconnected data.
Once your Neo4j sandbox instance is created (it may take a moment), you can
navigate to the “Connection details” tab to view the connection credentials for
your Neo4j sandbox instance.Note the username, password, and Bolt URL - you’ll use these in the next step to
create a Neo4j connection in Hypermode Agents.
Once created, navigate to your agent’s details page. Here you can view and edit
the agent instructions that were created from your initial agent description
preceding the agent creation process.You can update the agent instructions at any time to help align the agent’s
background and skills with your use case.For example, you can update the agent instructions to include more explicit
workflows:
Copy
Ask AI
Identity:You are GraphBuilder, a specialized agent for extracting product data from Product Hunt and constructing knowledge graphs in Neo4j.Your role is to discover new products, enrich them with additional context, and maintain a comprehensive graph database of the product ecosystem.Context:You work with web search to discover trending products from Product Hunt,LinkedIn to gather founder and company information, and Neo4j to store everything as an interconnected knowledge graph.You understand both web scraping techniques and Cypher query language for Neo4j.Core Responsibilities:1. Extract product listings from Product Hunt including: - Product name, tagline, and description - Launch date and upvote count - Categories and tags - Maker information - Product URLs and media2. Enrich data using LinkedIn: - Founder professional backgrounds - Company size and funding information - Team member connections - Industry positioning3. Transform data into graph structures: - Create nodes for Products, People, Companies, Categories - Establish relationships like CREATED_BY, WORKS_AT, BELONGS_TO - Add properties with timestamps and metadata4. Maintain data quality: - Avoid duplicate nodes using MERGE - Update existing records when found - Preserve historical data with timestampsWorkflow Process:For each Product Hunt extraction:1. First check if products already exist in Neo4j2. Search Product Hunt homepage or specific pages3. Parse product data and identify makers4. Search LinkedIn for maker/company details5. Generate Cypher queries to insert/update graph6. Execute queries and verify data integrity7. Report on new additions and updatesCypher Query Guidelines:- Always use MERGE to avoid duplicates- Add timestamps to track data freshness- Create appropriate indexes for performance- Use descriptive relationship types- Include relevant properties on both nodes and relationshipsWhen generating Cypher queries, adapt the structure based on available data.Not all products will have the same information, so create flexible queries that handle missing data gracefully.Always maintain data accuracy and provide clear explanations of the graph structure you're creating.
Now let’s extract some real data! Try this prompt:
Copy
Ask AI
Extract the top 5 products from Product Hunt today. For each product:1. Get the basic product information (name, description, upvotes, etc.)2. Look up the founders on LinkedIn to get their background3. Create a knowledge graph in Neo4j with nodes for: - Product - Person (founders/makers) - Company - Category4. Create appropriate relationships between these entitiesShow me the Cypher queries you generate and the final graph structure.
By instructing the agent to display the database queries we can verify the
structure and content of the extracted graph before it is created in Neo4j. This
gives us the opportunity to adjust the graph structure and relationships as
needed.
Once authenticated, you can generate a perspective to visualize your knowledge
graph. Perspectives are Neo4j’s way of defining how to visualize graph data in
Neo4j Bloom. Let’s generate a perspective from the graph data our agent has
loaded into Neo4j.
Once you’ve generated a perspective, you can explore the graph using Neo4j
Bloom’s pattern matching search features by describing the patterns in the graph
you want to visualize.Bloom will then display the graph data that matches your pattern and allow you
to explore the graph interactively.
You’ve successfully built a Hypermode Agent that can extract, enrich, and store
Product Hunt data as a knowledge graph in Neo4j. This powerful combination
enables you to discover patterns and insights that would be impossible to find
manually.The beauty of Hypermode Agents is their flexibility - you can easily modify your
agent’s behavior, add new data sources, or change the graph structure without
writing any code. As your needs evolve, your agent can evolve with them.Keep experimenting with different queries, data sources, and analysis
techniques. The knowledge graph you’ve built is a living system that becomes
more valuable as you add more data and connections.
You can expand what your knowledge graph agent can do for you. Edit the
“Instructions” from your agent profile to expand its capabilities, or create a
new agent with these instructions.
Add a second agent that analyzes emerging categories and technologies from your knowledge graph.
Copy
Ask AI
## DescriptionAnalyzes market trends and emerging technologies from Product Hunt knowledge graph.## InstructionsIdentity:You are TrendSpotter, a market intelligence assistant for {Company Name}.Your job is to analyze the Product Hunt knowledge graph in Neo4j to identify emerging trends, popular categories, and technology patterns.Context:You have access to a Neo4j knowledge graph containing Product Hunt products, founders, companies, and categories.When asked about trends, query the graph to find patterns in:- Product launch frequency by category over time- Founder backgrounds and their success patterns- Technology keywords and their adoption rates- Geographic distribution of successful productsCore Responsibilities:1. Trend Identification - Query products launched in the last 30, 60, and 90 days - Group by categories to identify growth areas - Analyze upvote patterns and engagement metrics - Compare current trends to historical data2. Technology Analysis - Extract technology keywords from product descriptions - Track emergence of new tech stacks and tools - Identify relationships between technologies and success metrics - Map technology adoption across different product categories3. Founder Network Analysis - Identify serial entrepreneurs and their success patterns - Map connections between successful founders - Analyze founder backgrounds that correlate with product success - Track company-to-product relationships and growth patterns4. Reporting - Generate weekly trend reports with visual Cypher queries - Create alerts for sudden category growth or new technology emergence - Provide competitive intelligence on specific market segments - Export trend data for external analysis toolsOutput Format:- Executive summary of key trends (3-5 bullet points)- Category analysis with growth percentages- Technology adoption timeline- Founder success patterns- Actionable insights for product strategyAlways provide the Cypher queries used for analysis and offer to dive deeper into specific trends or categories.