>ΦΟΡΤΩΣΗ // PROJECT DETAILS

PARSING ARCHITECTURE, DIAGRAMS & API ENDPOINTS

>ΦΟΡΤΩΣΗ // ΦΟΡΤΩΣΗ

ΑΡΧΙΚΟΠΟΙΗΣΗ ΠΡΟΒΟΛΗΣ

Επιστροφή στα έργα

Προβολή στο GitHub

Ολοκληρώθηκεgoneo4jmemgraphtigergraphdocker

Συγκριτική Αξιολόγηση Βάσεων Δεδομένων Γράφων

Σουίτα δοκιμών που αναλύει καθυστέρηση, κατανάλωση μνήμης και απόδοση ερωτημάτων σε γράφους και σχεσιακές βάσεις.

Πρόβλημα & Λύση

Επιλογή της κατάλληλης τεχνολογίας βάσης δεδομένων για κοινωνικά δίκτυα και μηχανές συστάσεων.

Χαρακτηριστικά

Αυτοματοποιημένες δοκιμές διάσχισης σε πολλαπλά επίπεδα βάθους
Σύγκριση εκατοστημορίων καθυστέρησης (p50, p95, p99)
Μετρήσεις χρήσης επεξεργαστή και μνήμης
Πλήρως αναπαραγώγιμο περιβάλλον μέσω Docker

Τεχνολογικό stack

Τεχνολογία	Έκδοση	Σκοπός	Γιατί επιλέχθηκε
Go	1.25.1	Primary language	Strong concurrency primitives, fast compilation, good driver ecosystem
neo4j-go-driver/v6	v6.2.0	Bolt protocol client for CognoDB, Neo4j, Memgraph	Official driver, supports Bolt 5.x, parameterized queries
go-echarts/v2	v2.7.2	HTML chart generation	Go-native, generates standalone HTML
godotenv	v1.5.1	Environment configuration	Standard .env loading
net/http	stdlib	REST client for TigerGraph	No external dependency needed

Αρχιτεκτονική

Benchmark CLI

Go 1.25.1

Dataset Extractor

Data Loader

Summary Generator

Chart Generator

raw/

SNAP soc-Pokec .gz

processed/

nodes.csv, relationships.csv

results/

JSONL, CSV, HTML

CognoDB Cloud

Bolt 5.x, US-East-4

Neo4j AuraDB

Bolt, US-East-1

Memgraph Cloud

Bolt, US East

TigerGraph Savanna

REST/OpenCypher

Benchmark Engine

Adapter pattern with common GraphDatabase interface (16 methods)
5 database adapters (4 active, FalkorDB disabled due to OOM)
Sequential workload executor with warm-up and measured iterations
Concurrent workload executor with N goroutines and sync.WaitGroup
Factory function for adapter creation from configuration

CLI Pipeline

10 CLI entry points: benchmark, captest, charts, cleanup, dataset, load, runall, summary, verify, verify-load
JSONL append-only result output for crash resilience
CSV summary aggregation with percentile calculation
HTML chart generation via go-echarts
Pipeline automation via runall (verify → load → benchmark → report)

Δομή έργου

cmd

benchmark

captest

charts

cleanup

dataset

load

runall

summary

verify

verify-load

internal

benchmark

concurrent.goConcurrent workload executor

measurement.goMeasurement struct + ResultWriter

runner.goSequential workload executor

safe.goPanic-recovery wrapper

database

cognodb

memgraph

neo4j

tigergraph

types

factory.goDatabase factory/registry

dataset

parser.goCSV node/relationship loader

API endpoints

Query Workloads (θύρα 0)

Μέθοδος	Διαδρομή	Σκοπός
Cypher	MATCH (n:Person {id: $id}) RETURN n.id AS id	Point lookup — single node by ID
Cypher	MATCH (n:Person {region: $val}) RETURN n.id AS id LIMIT 10	Indexed lookup — nodes by region
Cypher	MATCH (n:Person {id: $id})-[:FRIEND]->(m:Person) RETURN collect(m.id)	1-hop traversal — direct friends
Cypher	MATCH (n:Person {id: $id})-[:FRIEND]->()-[:FRIEND]->(m:Person) RETURN collect(DISTINCT m.id)	2-hop traversal — friends of friends
Cypher	MATCH (n:Person {id: $id})-[:FRIEND]->()-[:FRIEND]->()-[:FRIEND]->(m:Person) RETURN collect(DISTINCT m.id)	3-hop traversal — extended network
Cypher	MATCH (n:Person) RETURN n.region AS region, count(n) AS cnt ORDER BY cnt DESC LIMIT 10	Aggregation — region distribution
Cypher	CREATE (n:Person {id: $id, region: $region, ...})	Write — create new node

Σχεδιασμός βάσης δεδομένων

PERSON

5 cols

idPK

string

region

string

gender

string

age

string

completion_percentage

string

FRIEND_EDGE

2 cols

from_id

string

to_id

string

Person (node label)

Στήλη	Τύπος	Σημειώσεις
idPK	STRING	Unique constraint, indexed
region	STRING	Indexed
gender	STRING	Not indexed
age	STRING	Indexed (CognoDB, Neo4j, Memgraph only)
completion_percentage	STRING	Not indexed

49,683 nodes extracted from SNAP soc-Pokec dataset. All properties are strings.

FRIEND (relationship type)

Στήλη	Τύπος	Σημειώσεις
source_id	STRING	Person.id (from)
target_id	STRING	Person.id (to)

100,000 directed relationships. No properties on edges. Many-to-many cardinality.

Directed graph: Person --[FRIEND]--> Person. Many-to-many via graph relationships (no junction table). Relationships are first-class citizens in the graph model.

Βασικές σχεδιαστικές αποφάσεις

Single Bolt Driver for 3 Databases

Απόφαση: Use neo4j-go-driver/v6 for CognoDB, Neo4j, and Memgraph

Λόγος: All three support Bolt protocol; Cypher is logically equivalent

Οφέλη: Code reuse, consistent behavior across databases, adapter pattern isolates DB-specific behavior

Ανταλλάγματα: Cannot test database-specific optimizations; Memgraph has its own Go driver

MaxPoolSize = 1

Απόφαση: Single connection per benchmark run despite constant defining 10

Λόγος: Measure single-connection latency; avoid connection pool effects

Οφέλη: Clean latency measurement without pool contention

Ανταλλάγματα: Doesn't test connection pooling behavior

JSONL for Raw Results

Απόφαση: One JSON object per line, append-only output

Λόγος: Stream results without loading all into memory; easy to append across runs

Οφέλη: Resilient to crashes (partial results preserved)

Ανταλλάγματα: Requires full file scan for aggregation

No Retries on Measured Queries

Απόφαση: Zero retries for benchmark queries to capture true latency

Λόγος: Network blips and failures are part of real-world performance

Οφέλη: Honest performance measurement including failure modes

Ανταλλάγματα: Network blips cause false negatives

Goroutine-Per-Client Concurrency

Απόφαση: Each concurrent client creates its own database connection

Λόγος: Simulates real-world multi-client scenarios; avoids shared connection contention

Οφέλη: Realistic concurrency testing with independent connections

Ανταλλάγματα: Higher resource usage; connection limits become the bottleneck

MERGE for Idempotent Node Loading

Απόφαση: Use MERGE (upsert) instead of CREATE for node loading

Λόγος: Makes loading idempotent — running multiple times doesn't create duplicates

Οφέλη: Safe re-runs, consistent dataset state

Ανταλλάγματα: MERGE is slightly slower than CREATE due to existence checks

Δοκιμές

None (no _test.go files)•0 μονάδες δοκιμών

Τι δοκιμάζεται

Capability test matrix (cmd/captest/) — tests all 8 workload types against all databases with small 10-node graph
Connection verification (cmd/verify/) — tests basic connectivity and parameterized queries
Data integrity verification (cmd/verify-load/) — verifies node/relationship counts (49,683 nodes, 100,000 relationships)

Κενά κάλυψης

No unit tests for individual functions (_test.go files do not exist)
No tests for statistical functions (percentile, mean, stddev calculation)
No tests for CSV parsing edge cases (empty datasets, malformed CSVs)
No tests for concurrent behavior
No tests for chart generation correctness
No test framework installed (no testify, gomock)

Βασικές προκλήσεις

Διασφάλιση δίκαιων συνθηκών φόρτου για κάθε τεχνολογία
Αποτροπή εξάντλησης μνήμης κατά τη βαθιά διάσχιση

Βασικά διδάγματα

Πλεονεκτήματα και περιορισμοί εγγενών βάσεων γράφων έναντι RDBMS
Μεθοδολογία μετρήσεων καθυστέρησης υπό υψηλό φόρτο

>ΦΟΡΤΩΣΗ // PROJECT DETAILS

PARSING ARCHITECTURE, DIAGRAMS & API ENDPOINTS

Επιστροφή στα έργα

Προβολή στο GitHub

Ολοκληρώθηκεgoneo4jmemgraphtigergraphdocker

Συγκριτική Αξιολόγηση Βάσεων Δεδομένων Γράφων

Πρόβλημα & Λύση

Επιλογή της κατάλληλης τεχνολογίας βάσης δεδομένων για κοινωνικά δίκτυα και μηχανές συστάσεων.

Χαρακτηριστικά

Αυτοματοποιημένες δοκιμές διάσχισης σε πολλαπλά επίπεδα βάθους
Σύγκριση εκατοστημορίων καθυστέρησης (p50, p95, p99)
Μετρήσεις χρήσης επεξεργαστή και μνήμης
Πλήρως αναπαραγώγιμο περιβάλλον μέσω Docker

Τεχνολογικό stack

Τεχνολογία	Έκδοση	Σκοπός	Γιατί επιλέχθηκε
Go	1.25.1	Primary language	Strong concurrency primitives, fast compilation, good driver ecosystem
neo4j-go-driver/v6	v6.2.0	Bolt protocol client for CognoDB, Neo4j, Memgraph	Official driver, supports Bolt 5.x, parameterized queries
go-echarts/v2	v2.7.2	HTML chart generation	Go-native, generates standalone HTML
godotenv	v1.5.1	Environment configuration	Standard .env loading
net/http	stdlib	REST client for TigerGraph	No external dependency needed

Αρχιτεκτονική

Benchmark CLI

Go 1.25.1

Dataset Extractor

Data Loader

Summary Generator

Chart Generator

raw/

SNAP soc-Pokec .gz

processed/

nodes.csv, relationships.csv

results/

JSONL, CSV, HTML

CognoDB Cloud

Bolt 5.x, US-East-4

Neo4j AuraDB

Bolt, US-East-1

Memgraph Cloud

Bolt, US East

TigerGraph Savanna

REST/OpenCypher

Benchmark Engine

Adapter pattern with common GraphDatabase interface (16 methods)
5 database adapters (4 active, FalkorDB disabled due to OOM)
Sequential workload executor with warm-up and measured iterations
Concurrent workload executor with N goroutines and sync.WaitGroup
Factory function for adapter creation from configuration

CLI Pipeline

10 CLI entry points: benchmark, captest, charts, cleanup, dataset, load, runall, summary, verify, verify-load
JSONL append-only result output for crash resilience
CSV summary aggregation with percentile calculation
HTML chart generation via go-echarts
Pipeline automation via runall (verify → load → benchmark → report)

Δομή έργου

cmd

benchmark

captest

charts

cleanup

dataset

load

runall

summary

verify

verify-load

internal

benchmark

concurrent.goConcurrent workload executor

measurement.goMeasurement struct + ResultWriter

runner.goSequential workload executor

safe.goPanic-recovery wrapper

database

cognodb

memgraph

neo4j

tigergraph

types

factory.goDatabase factory/registry

dataset

parser.goCSV node/relationship loader

API endpoints

Query Workloads (θύρα 0)

Μέθοδος	Διαδρομή	Σκοπός
Cypher	MATCH (n:Person {id: $id}) RETURN n.id AS id	Point lookup — single node by ID
Cypher	MATCH (n:Person {region: $val}) RETURN n.id AS id LIMIT 10	Indexed lookup — nodes by region
Cypher	MATCH (n:Person {id: $id})-[:FRIEND]->(m:Person) RETURN collect(m.id)	1-hop traversal — direct friends
Cypher	MATCH (n:Person {id: $id})-[:FRIEND]->()-[:FRIEND]->(m:Person) RETURN collect(DISTINCT m.id)	2-hop traversal — friends of friends
Cypher	MATCH (n:Person {id: $id})-[:FRIEND]->()-[:FRIEND]->()-[:FRIEND]->(m:Person) RETURN collect(DISTINCT m.id)	3-hop traversal — extended network
Cypher	MATCH (n:Person) RETURN n.region AS region, count(n) AS cnt ORDER BY cnt DESC LIMIT 10	Aggregation — region distribution
Cypher	CREATE (n:Person {id: $id, region: $region, ...})	Write — create new node

Σχεδιασμός βάσης δεδομένων

PERSON

5 cols

idPK

string

region

string

gender

string

age

string

completion_percentage

string

FRIEND_EDGE

2 cols

from_id

string

to_id

string

Person (node label)

Στήλη	Τύπος	Σημειώσεις
idPK	STRING	Unique constraint, indexed
region	STRING	Indexed
gender	STRING	Not indexed
age	STRING	Indexed (CognoDB, Neo4j, Memgraph only)
completion_percentage	STRING	Not indexed

49,683 nodes extracted from SNAP soc-Pokec dataset. All properties are strings.

FRIEND (relationship type)

Στήλη	Τύπος	Σημειώσεις
source_id	STRING	Person.id (from)
target_id	STRING	Person.id (to)

100,000 directed relationships. No properties on edges. Many-to-many cardinality.

Directed graph: Person --[FRIEND]--> Person. Many-to-many via graph relationships (no junction table). Relationships are first-class citizens in the graph model.

Βασικές σχεδιαστικές αποφάσεις

Single Bolt Driver for 3 Databases

Απόφαση: Use neo4j-go-driver/v6 for CognoDB, Neo4j, and Memgraph

Λόγος: All three support Bolt protocol; Cypher is logically equivalent

Οφέλη: Code reuse, consistent behavior across databases, adapter pattern isolates DB-specific behavior

Ανταλλάγματα: Cannot test database-specific optimizations; Memgraph has its own Go driver

MaxPoolSize = 1

Απόφαση: Single connection per benchmark run despite constant defining 10

Λόγος: Measure single-connection latency; avoid connection pool effects

Οφέλη: Clean latency measurement without pool contention

Ανταλλάγματα: Doesn't test connection pooling behavior

JSONL for Raw Results

Απόφαση: One JSON object per line, append-only output

Λόγος: Stream results without loading all into memory; easy to append across runs

Οφέλη: Resilient to crashes (partial results preserved)

Ανταλλάγματα: Requires full file scan for aggregation

No Retries on Measured Queries

Απόφαση: Zero retries for benchmark queries to capture true latency

Λόγος: Network blips and failures are part of real-world performance

Οφέλη: Honest performance measurement including failure modes

Ανταλλάγματα: Network blips cause false negatives

Goroutine-Per-Client Concurrency

Απόφαση: Each concurrent client creates its own database connection

Λόγος: Simulates real-world multi-client scenarios; avoids shared connection contention

Οφέλη: Realistic concurrency testing with independent connections

Ανταλλάγματα: Higher resource usage; connection limits become the bottleneck

MERGE for Idempotent Node Loading

Απόφαση: Use MERGE (upsert) instead of CREATE for node loading

Λόγος: Makes loading idempotent — running multiple times doesn't create duplicates

Οφέλη: Safe re-runs, consistent dataset state

Ανταλλάγματα: MERGE is slightly slower than CREATE due to existence checks

Δοκιμές

None (no _test.go files)•0 μονάδες δοκιμών

Τι δοκιμάζεται

Capability test matrix (cmd/captest/) — tests all 8 workload types against all databases with small 10-node graph
Connection verification (cmd/verify/) — tests basic connectivity and parameterized queries
Data integrity verification (cmd/verify-load/) — verifies node/relationship counts (49,683 nodes, 100,000 relationships)

Κενά κάλυψης

No unit tests for individual functions (_test.go files do not exist)
No tests for statistical functions (percentile, mean, stddev calculation)
No tests for CSV parsing edge cases (empty datasets, malformed CSVs)
No tests for concurrent behavior
No tests for chart generation correctness
No test framework installed (no testify, gomock)

Βασικές προκλήσεις

Διασφάλιση δίκαιων συνθηκών φόρτου για κάθε τεχνολογία
Αποτροπή εξάντλησης μνήμης κατά τη βαθιά διάσχιση

Βασικά διδάγματα

Πλεονεκτήματα και περιορισμοί εγγενών βάσεων γράφων έναντι RDBMS
Μεθοδολογία μετρήσεων καθυστέρησης υπό υψηλό φόρτο