Orca on AWS with Bedrock — 7 Lessons from My First Week
A week running Orca on AWS explains the move to GPU-backed EC2, private mobile access, and the IAM and Linux permissions needed for Bedrock and local SDKs.
A week running Orca on AWS explains the move to GPU-backed EC2, private mobile access, and the IAM and Linux permissions needed for Bedrock and local SDKs.
Building a local multi-agentic RAG app used to be a lab curiosity. Over the last 18 months, WebGPU, Transformers.js v4.2.0's fused ONNX kernels, and ~500 MB OPFS quotas quietly crossed their production thresholds — and the full stack an agentic app needs (orchestrator SLM, embedder, reranker) now fits in a single browser tab. This post is a builder's guide to the reference architecture: a Next.js app that runs Qwen3.5-0.8B-Text, Nomic Embed v1.5, and bge-reranker-base entirely on the user's GPU, routes through Strands TS hierarchical sub-agents, and scopes retrieval per document via Orama's where pre-filter. Honest on the limits (cold start, small-model routing, OPFS quirks) and specific on the gotchas (Chrome's Cache API silently drops entries above ~200 MB).
Why You Should Add AWS MCP ServersPrerequisitesThe 7 AWS MCP Servers and How to Add ThemManaging Servers: Reconnect, List, RemoveA Note on "Disable"Troubleshooting: When Servers Fail to ConnectBenefits of Using…
Learn how to deploy Next.js 16 to Azure App Service using standalone output. Fix common errors like "next: not found" with this battle-tested guide.
Unlock modern AI with Vector Embeddings. Power RAG and Semantic Search by transforming unstructured data into numerical representations (vectors) stored in a high-performance Vector Database.
Discover how Amazon Nova Web Grounding eliminates AI hallucinations by automatically retrieving current, cited web information. This comprehensive guide covers step-by-step implementation with Amazon Bedrock, real-world use cases including financial analysis and news aggregation, best practices for prompt engineering, and practical code examples for building trustworthy AI applications with real-time data.
This post demosntrates building scalable resume parsing with Amazon Bedrock Data Automation. Complete IDP guide with CDK, Lambda, S3 integration for automated document IDP using GenAI on AWS. It's Monday…
Learn how to benchmark LLMs on Amazon SageMaker endpoints. We will be benchmarking Llama 2 13B chat model on Amazon SageMaker Endpoint using awscurl.
I have made a series of tutorials that will help you get started on working with GCP for ASP.NET Core Web Application development. Google Cloud for ASP.NET Core Web Apps…
In this tutorial, we will see how to work with Google Cloud Storage when implementing ASP.NET Core MVC applications using Entity Framework Core. The same approach described in this step-by-step tutorial will be applicable to ASP.NET Core WebAPI projects or ASP.NET Core Minimal API projects.