Skip to content

Repository files navigation

Public Intelligence Node

A Public Intelligence Node is a compute worker that joins the network, advertises available models, executes inference locally using Ollama, and communicates with the Scheduler.

Version 1 establishes the complete lifecycle of a compute node.


Current Features

  • Scheduler registration
  • Heartbeats
  • Ollama integration
  • Local inference API
  • Runtime lifecycle management
  • Graceful shutdown
  • End-to-end demonstration
  • Comprehensive test suite

Architecture

            Scheduler

               ▲

 Registration / Heartbeats

               │

               ▼

        Public Intelligence Node

               │

               ▼

          Ollama Client

               │

               ▼

             Ollama

Running

Start Ollama

ollama serve

Run the Node

python -m node.main

Demo

A walkthrough of the first working prototype is available on YouTube: Public Intelligence v1 Demo

This video demonstrates the end-to-end integration of the Website, Scheduler, Node (showing the current v1 implementation), registration, heartbeats, and local inference.

A local end-to-end text demonstration is also available in examples/demo.md.


Version

Current Release

v1.0.0

Future Work

Version 2 will introduce:

  • Automatic hardware discovery
  • Better runtime metrics
  • Improved monitoring
  • Enhanced node capabilities

Related Repositories

  • Public Intelligence Scheduler
  • Public Intelligence Website

License

Apache 2.0

About

Compute node that hosts local AI models, executes inference, and contributes compute to the Public Intelligence network.

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages