Fungible GPU-Connect (FGC) provides the capability to dynamically compose GPUs and connect them to CPUs over a standard Ethernet network. Centralizing GPUs into a single pool that can be attached on demand eliminates the need for dedicated GPUs. This disaggregation removes the constraints of having GPUs and CPUs physically co-located within the same server and delivers GPU processing power independent of application’s CPU requirements. Expensive GPU resources are no longer left stranded. FGC allows any host server to receive physical GPU resources from a centralized GPU pool anywhere within the same data center.
I worked on the composability team at Fungible and was part of its architecture review board.
I made key decisions ranging from our web architecture to our
source control workflow. My day-to-day responsibilities included:
- Implementing features and managing the team responsible for the Composer Cloud
Console. The Console, consisting of 600 custom Angular components, allows users
to compose pools of GPUs, servers, storage arrays, and networking infrastructure
to run workloads. To manage complexity and maintain performance, I devised a micro-frontend
architecture with federated auth. I used a Node.js web server
to deliver content and enable lazily loading the micro apps.
- Defining a continuous integration pipeline to automate builds, enforce test
coverage and code style, and deploy new bundles to the web server. I leveraged
Docker images to ensure consistent builds on Jenkins and configured the
Helm templates of the various microservices the Console depends on.
- Designing the APIs of microservices. We leverage OpenAPI to unify the capabilities
of our microservices and statically generate TypeScript and Python types.
By working together with the API teams to define the OpenAPI spec, we implement
new features in parallel, accelerating the development lifecycle. I ensured
the OpenAPI schemas were composable and the endpoints used RESTful conventions.
- Crafting the data models of microservices. I ensured our data was efficiently
structured based on our highest-volume queries and the characteristics
of the entities we model. This included designing materialized views to
reduce latency and defining triggers to maintain consistency.
- Interfacing with the User Experience (UX) team to establish a design system.
To successfully introduce a micro-frontend architecture, we needed a strategy to
ensure the individual micro apps operated cohesively. I worked with
the UX team to produce a design system and component library. By implementing
the component library according to the tenants of our design system, each app
can pull in a versioned NPM package containing various UI building
blocks. Leveraging components from our prebuilt library gives the product a
consistent look and feel and reduces the development timeline, as the custom
components are already built and tested.