Blog
Volatility Comes with a Price
In some cases, quants might even make the wrong trades during market volatility, causing top line to decrease, but just to keep up with a systematic or quantitative strategy, we still literally need more computers. Market volatility rewards proactive platform engineering.
How a Machine Learning Expert thinks about RAG vs Fine-tuning
Some consider RAG a “hack”, but fine-tuning your own proprietary models comes with its own challenges.
What Does DeepSeek Mean for Enterprise AI?
Since OpenAI introduced ChatGPT in December 2022, the world has been swept up in the wave of Generative AI. Enterprises are now actively exploring how to leverage AI to increase productivity, streamline operations, and gain a competitive edge in an increasingly digital-first world. Software development, IT management, and customer support were among the first to feel the impact.
Accelerating Data Retrieval in Retrieval Augmentation Generation (RAG) Pipelines using CXL
RAG (retrieval augmented generation) has emerged as a powerful technique to customize LLMs for users and use cases beyond the model’s training set. However, there are multiple potential bottlenecks within a RAG pipeline.
Jupyter Crashing
Understanding the differences between Jupyter Notebook (includes Jupyter Server) and JupyterLab is crucial for diagnosing why your notebook crashes, as they integrate server and client functionalities differently. The following article will primarily focus on Jupyter Notebooks.
Introducing Weighted Interleaving in Linux for Enhanced Memory Bandwidth Management
With the release of Linux Kernel 6.9, system administrators have gained a powerful new tool for managing memory distribution across NUMA nodes: Weighted Interleaving. This feature is especially beneficial in systems utilizing various types of memory, including traditional DRAM and Compute Express Link (CXL) attached memory. In this article, we’ll explore Weighted Interleaving, how it works, and how to use it.
What to do During a Spot Instance Interruption?
In this article, we’ll dive into effective strategies to ensure your applications and deployments can leverage Spot Instance interruptions while keeping your operations smooth and costs under control.
Unleashing the Future of Memory Management: Exploring CXL Dynamic Capacity Devices with Docker and QEMU
In the ever-advancing realm of technology, developers and application owners always look for innovative tools and methodologies to boost performance and scalability. A revolutionary stride in this direction is the integration of Compute Express Link (CXL) technology, particularly through the utilization of Dynamic Capacity Devices (DCD). CXL, an open standard for high-speed CPU-to-device and CPU-to-memory interconnects, substantially enhances data center and cloud environments, offering many benefits.
Memory Wall, Big Memory, and the Era of AI
In the fast-evolving landscape of artificial intelligence (AI), where models are growing larger and more complex by the day, the demand for efficient processing of vast amounts of data has ushered in a new era of computing infrastructure.
AWS Spot Price History
AWS spot pricing offers substantial discounts for cost-conscious cloud consumers, yet it comes with its own set of unique concerns. This article breaks down AWS Spot’s dynamic pricing model, exploring its features, advantages, and potential drawbacks.