add presentations
This commit is contained in:
45
presentations/local_ai_discord_bots.md
Normal file
45
presentations/local_ai_discord_bots.md
Normal file
@@ -0,0 +1,45 @@
|
||||
# Bio
|
||||
|
||||
Reese is DIY technology enthusiast with a passion for projects that make things
|
||||
easy. He's been working in development since 2017 with experience in risk,
|
||||
compliance, scripting automation, full stack web development, container
|
||||
infrastructure, homelab server hardware, ESP Home and home automation. Reese
|
||||
has a passion for mentoring, but even more of a passion for sharing the new
|
||||
tech he found last week with anyone who will listen. Reese wants tech to be
|
||||
fun and approachable for anyone at any skill level.
|
||||
|
||||
## Credentials
|
||||
|
||||
Reese has spoken at multiple company conferences about building websites and
|
||||
automating with Python. He's taught multi-day intro-to-python classes both
|
||||
online and in person. He has 8 years of industry experience, 3 of which have
|
||||
been spent growing the development team at a Nimbis Services. Reese has,
|
||||
professionally and personally, written and distributed Python pip packages,
|
||||
designed and hosted websites, built and deployed a version control system, led
|
||||
AI development teams, taught Python classes, mentored high school students in
|
||||
tech, annoyed his friends with discord bots, and automated his bathroom fans.
|
||||
He's accustomed to speaking in front of large and small audiences and relishes
|
||||
the opportunity to share his excitement with a crowd.
|
||||
|
||||
## Abstract
|
||||
|
||||
This talk will walk through the process of putting your local LLM to good* use.
|
||||
Through the medium of a Discord bot, we will explore how to leverage llama.cpp
|
||||
to give your friends the ability to create custom bots with custom
|
||||
personalities, have those personalities talk with each other, generate images,
|
||||
edit images, and set yourself up to leverage tool calling so your bots can
|
||||
interact with the real world.
|
||||
|
||||
We will cover the state of hosting offline LLMs and discuss some strategies for
|
||||
hosting them safely with Podman, Bifrost, and Caddy. We will also discuss the
|
||||
current state of LLM hardware and give some realistic examples with AMD, Intel,
|
||||
Nvidia, and CPU based solutions. We will not be using cloud examples, as this
|
||||
talk will focus on avoiding cloud solutions in general. We will poke fun at
|
||||
leveraging Discord as our example if our goal is to self-host.
|
||||
|
||||
Ultimately, I want this talk's participants to leave with some functional code
|
||||
and good ideas to get them thinking about ways they can integrate LLMs into
|
||||
their communities while maintaining control and privacy (and avoiding a hefty
|
||||
bill). This talk will emphasize audience participation to generate ideas for a
|
||||
prebuilt demo of the custom bot service, but will not build anything live
|
||||
during the presentation.
|
||||
109
presentations/self_hosting_presentation.md
Normal file
109
presentations/self_hosting_presentation.md
Normal file
@@ -0,0 +1,109 @@
|
||||
# Idea
|
||||
|
||||
## Abstract
|
||||
|
||||
Ever find yourself Googling "how do I build a home server" only to get
|
||||
overwhelmed by enterprise-grade documentation? Welcome to our journey from
|
||||
confused beginner to building a home server that's actually useful.
|
||||
|
||||
Join us as we walk through real-world projects that solved actual problems:
|
||||
backing up family photos, hosting private Git repositories, running local AI
|
||||
models, managing home media, and yes—even running multiple Minecraft servers on
|
||||
a single box. We'll explore hardware choices, operating systems,
|
||||
containerization vs VMs, and the pain points that motivated each decision.
|
||||
|
||||
This isn't a theory-heavy presentation—it's a story-driven exploration of
|
||||
building infrastructure for real people with real needs. When you're done,
|
||||
you'll leave with a roadmap for your own server that balances automation,
|
||||
redundancy, and the "I just want this to work" factor.
|
||||
|
||||
Some prior sysadmin knowledge required. All projects are from personal
|
||||
experience, with stories about what went wrong and how we fixed it.
|
||||
|
||||
## Structure
|
||||
|
||||
"I'm lazy, I don't want my family to kill me, and it works"
|
||||
|
||||
1. I want this in my house
|
||||
2. I want to connect outside my house
|
||||
3. I want my friends to connect
|
||||
4. I don't want this to go down
|
||||
5. I want to recover if there's an error
|
||||
6. My house burned down, what now?
|
||||
|
||||
## Thoughts
|
||||
|
||||
Give 2 ideas per section. First for "I can't let this break my family will kill
|
||||
me". Second for "I have an understanding partner who is my cat and won't care."
|
||||
|
||||
Story driven presentation
|
||||
|
||||
I have decided to make a strong home server. Where do I even start?
|
||||
|
||||
Hardware: you find a box (old laptop, rpi) you're set.
|
||||
|
||||
- Operating system (proxmox, truenas, fedora, arch linux)
|
||||
- Alex: truenas apps
|
||||
- Reese: Fedora, osbuild
|
||||
|
||||
1. Install native app (npm, pip, apt, dnf, etc)
|
||||
2. Containerized (kube, docker, podman)
|
||||
3. VM (vm, pick one or two)
|
||||
|
||||
- Ingress (nginx, caddy, haproxy)
|
||||
- Backups (rsync, borg, btrfs send, zfs send)
|
||||
|
||||
1. I want to install a new app while I'm at friend's house
|
||||
1. Truenas web portal (app page, both official and community)
|
||||
2. VPN and I need access to my computer
|
||||
2. I want to check my server status on my phone (updates, disks, memory pressure, error logs, services running)
|
||||
1. Truenas web interface
|
||||
2. Cockpit web interface
|
||||
3. I want to add more storage
|
||||
1. Truenas ZFS storage pools
|
||||
2. BTRFS pools
|
||||
4. I want to install a new alpha app without much support
|
||||
1. Truenas custom docker compose images
|
||||
2. Fedora clone and run (in a VM for style)
|
||||
5. I want to backup my photos
|
||||
1. Google Photos: don't use git, images aren't meant for git
|
||||
2. **Immich, with backups (tell stories about losing my image data)**
|
||||
6. I want a local copy of my code
|
||||
1. Github
|
||||
2. Gitea/Gitlab (talk about that transition)
|
||||
7. I want private document editing
|
||||
1. Google drive, Obsidian (forces use of markdown as my standard)
|
||||
2. VSCode + pandoc (commit markdown files as your documents)
|
||||
3. Nextcloud (Collabora)
|
||||
8. I want a local, offline LLMs
|
||||
1. llama.cpp, stable diffusion cpp, bifrost
|
||||
2. Ollama is switching to cloud based models
|
||||
9. I want to watch media I own
|
||||
1. Plex boi - I know that ruffles some jimmies. Give example: add letterbox support into Plex.
|
||||
2. Jellyfin if you're cheap
|
||||
10. I want to know when something goes wrong
|
||||
1. Uptime Kuma!
|
||||
2. Truenas sending emails if there's an error
|
||||
3. Fedora requires a custom solution.
|
||||
11. I want "reasonable availability"
|
||||
1. Truenas hits 90%+ availability. Updates take it down for reboot (5-10
|
||||
minutes). Disk failure requires full shutdown, disk swap, and rebuild.
|
||||
This could be half a day.
|
||||
2. Fedora hits 90%+ availability. Updates take it down for reboot (<1 min).
|
||||
Disk failures can be ignored by rebalancing. Disk failures still require
|
||||
full shutdown and resilver. This can take half a day.
|
||||
12. I want to host multiple minecraft servers (SRV records)
|
||||
1. AWS Route53 for automating SRV records.
|
||||
2. Pihole is in the territory of making your family mad
|
||||
13. I want to automate my house
|
||||
1. Home Assistant (raspberry pi or green)
|
||||
14. I want backups of all my data
|
||||
1. No backups is an option
|
||||
2. Local weekly backups to usb drives via Truenas data replication
|
||||
3. Borg backup via CLI or Pika.
|
||||
4. Full disk backups, app directory backups, hybrid model
|
||||
5. Backblaze and S3 integration for Truenas
|
||||
6. 3 copies of your data, 2 different media,1 off site.
|
||||
15. I want a private VPN
|
||||
1. Tailscale, moved from wifiman, also moved from pivpn
|
||||
2. unifi wireguard server, rawdog wireguard on a pi
|
||||
Reference in New Issue
Block a user