rhatdan

7 ms·

1.
RamaLama: Support for Simply Running AI Models with RAG Database(developers.redhat.com)
1 points by rhatdan 1y ago|1 comments
2.
by rhatdan 1y ago
I wrote a blog on an exciting new feature of RamaLama to allow users to take their documents (pdf, docx, md, ...) and translate them into a RAG database in a container image and then use it with an AI Model. With only two simple commands.
3.
by rhatdan 2y ago
Bottom line we want to take advantage of the infrastructure created by Podman, Docker and Kubernetes.
4.
by rhatdan 2y ago
One of my primary goals of RamaLama was to allow users to move AI Models into containers, so they can be stored in OCI Registries. I believe there is going to be a proliferation of "private" models, and eventually "private&q
5.
by rhatdan 2y ago
Look for krunkit for GPU/Cuda Accelerator. Should be much better support in podman 5.2 out next month, I believe. You can use it now if you grab it from brew.
6.
by rhatdan 2y ago
Linux containers require a Linux kernel. Any tool on a MAC that is running containers locally is doing it in a VM.
7.
by rhatdan 2y ago
I meant registry.fedoraproject.org/fedora-bootc
8.
by rhatdan 2y ago
Using bootc-image-builder ( https://github.com/osbuild/bootc-image-builder ) You can convert a bootc image into multiple different formats including vmdk, iso, raw, qcow2 ...
9.
by rhatdan 2y ago
registry.redhat.io/rhel9/rhel-bootc registry.redhat.io/rhel9/rhel-bootc quay.io/centos-bootc/centos-bootc Are currently available, but since this is an open source project, we look forward to other distros crea
10.
by rhatdan 2y ago
There is also a fedora-bootc registry.fedoraproject.org/fedora-bootc:latest
11.
by rhatdan 3y ago
Administrators who want to share access to a system and part of its data but control what users are able to see on the system. Think sharing special devices. Think sharing certain directory content that containers secret data, for the users
12.
by rhatdan 3y ago
I see some misunderstanding of the goal of Podmansh. The basic idea is certain users have secure systems where they want to allow limited access to the host system. For example you might have some secret data on a system, where a user can o
13.
by rhatdan 3y ago
Do you run with Docker daemon running in rootless mode? Does rancher default to rootless mode? I hear Docker can run in rootless mode but does anyone really run it that way. If I want to start a single container in my homedir, I need to s
14.
by rhatdan 4y ago
Podman is a community project. Anyone can setup repos to update any distribution. Many distributions are managing versions of Podman. OpenSuse, Fedora, Centos, RHEL, Debian, Arch all supply updates. There is also the Kubic project in which
15.
by rhatdan 4y ago
It works in the home directory. Just place the quadlet file in $HOME/.config/containers/systemd $ systemctl --user daemon-reload $ systemctl --user start QUADLETNAME.service If you want this to work at boot, you need to do l
16.
by rhatdan 4y ago
Sure but to me, and I am obviously biased, if I want to run a container on my system I don't want to fire up multiple daemons in my homedir and then have them sitting out there using resources, when all I want to do is run a containeri
17.
by rhatdan 4y ago
Podman can actually quite easily run host environments in containers with systemd running as PID1, giving you very similar features as LXC. Checkout `podman run --rootfs`
18.
by rhatdan 4y ago
This is also related to the Client Server model supported by Docker versus the Fork/Exec Model supported by Podman. Podman works closely with the HPC (High Performance Computing) world. Checkout the article about how the fastest comput
19.
by rhatdan 4y ago
BTW Podman now supports pasta as well as slirp4netns. I am told pasta gives you better network performance in rootless mode, although I have never tried it.
20.
by rhatdan 4y ago
No, but you can precreate a network namespace and allow rootless Podman to join the network namespace.
21.
by rhatdan 4y ago
Agree, I believe that the world should move to using Kubernetes YAML for running multiple container workloads. Whether you are running on a single node or in a kubernetes cluster. Docker-Compose while supported by Podman, does not allow yo
22.
by rhatdan 4y ago
Sure, and bottom line the OS/Kernel prevent you from doing some things in rootless mode, although we are always attempting to push the boundaries on what is allowed, in a secure way. Rootless mode works for the great majority of contai
23.
by rhatdan 4y ago
There have been major vulnerabilities over the years where being root allow the container to take over the system. Checkout https://www.stackrox.io/blog/the-runc-vulnerability-a-deep-d...
24.
by rhatdan 4y ago
Running containers without a daemon in rootful and rootless mode is better and more secure in many ways. If you want to understand all of the security features of Podman take a look at chapters 10 and 11 of my book `Podman in Action`. In th
25.
by rhatdan 4y ago
Most of these are issues with running rootless not necessarily with running podman. Podman in rootful mode does not have most of these issues.
26.
by rhatdan 4y ago
BTW Podman has been ported to FreeBSD and works with jails. Although I have never tried it.
27.
by rhatdan 4y ago
If you enable the podman-restart service on the linux server, restart on boot should work fine. For rootless containers, you also need to enable linger mode for the rootless user.
28.
by rhatdan 4y ago
For those who have bought the book, thank you. You can buy copies at https://www.manning.com/books/podman-in-action Or download the free PDF from Red Hat at: https://developers.redhat.com/e-books/p
29.
by rhatdan 4y ago
Yes Podman is a completely free and open source project. It will never charge for uses and anyone can contribute. Come to github.com/containers/podman and join the community.
30.
by rhatdan 4y ago
If you read the book, you will find all of the advances that Podman has added over Docker. Pods, Kubernetes Yaml support, full integration to systemd, auto updating on containers on Edge devices ...

More ›