BestTechVideos: Tag cluster Videos

YAPC::ASIA: Behind the Scenes at LiveJournal: Scaling Storytime

scoundrel — Mon, 07 May 2007 09:23:22 GMT

Hear the history and lessons learned while scaling a community site (LiveJournal.com) from a single server with a dozen friends to hundreds of machines and 10M+ users. What's worked, what hasn't, and all the things we've had to build ourselves, now in common use throughout the "Web 2.0" world, including memcached, MogileFS, Perlbal, and our job dispatch systems.

Read more about this video…

Want to control this feed contents? Sign up here and create your own feed!

Want more on these topics?
Browse the archive of posts filed under Conferences, Databases, Development, Broadcasting, MySQL, Perl, Lectures

LinuxConf.Au: clustering tdb - a little database meets big iron

scoundrel — Fri, 06 Apr 2007 12:41:56 GMT

The little tdb database has been at the heart of Samba for many years. More recently it has become a focus in the efforts to create a clustered Samba solution. Attempts to cluster Samba in the past have been patchy at best, oftentimes resulting in a solution which relies on "relaxed" data coherence rules, which is a polite way of saying that they can lose user data. In the last few months we have finally worked out a architecture for a clustered tdb which will allow us to achieve 3 goals simultaneously:

scaling to large numbers of nodes in a cluster (potentially into the hundreds)
robustness to node crashes and new nodes entering the cluster
correct data coherence rules, so user data is not at risk

This talk will present the solution we have come up with, and will discuss our (very early!) experiments in implementing it.

Read more about this video…

Want to control this feed contents? Sign up here and create your own feed!

Want more on these topics?
Browse the archive of posts filed under OS, Conferences, Broadcasting, Networking, Linux, LinuxConf.AU, Lectures, Netbios

LinuxConf.Au: Linux Clusters

scoundrel — Thu, 29 Mar 2007 11:19:42 GMT

Clusters are defined as a set of computers working as one to execute tasks. The applications for it has no limit: from balance requests for web services to systems for explore petroleum, the amount of saves can be from thousands to gazillions of dollars. More then that, it is an extensive and interesting area. The Open Source community has been know as a big player in Clusters, with several of the biggest clusters in the world running Linux. And the tools available for it improve quickly. Distributed file systems, fault tolerance software, data replication, monitoring and service takeover are some of softwares developed to create those environments.

In this presentation I want to explain about how to provide this services in differents enviroments and which softwares choose for each kind of situation. We will go through the basics of Clusters, HA, LB and how to identify the pieces involved in a complete solution. Then we will show the available softwares, the advantages and not so good issues of each one, and help the administrator to create a complete environment. This presentation will show several implementations of Clusters - high availability, high processing computing and load balance - and the technologies for each one. We are going to talk about DRBD, Heartbeat, Ultramonkey, Linux Virtual Server, Global FileSystem and more.

Read more about this video…

Want to control this feed contents? Sign up here and create your own feed!

Want more on these topics?
Browse the archive of posts filed under OS, Conferences, Broadcasting, Networking, Linux, LinuxConf.AU, Lectures, TCP/IP

LinuxConf.Au: Linux-HA (heartbeat) release 2 tutorial

scoundrel — Thu, 22 Mar 2007 00:17:55 GMT

Audience: System Administrators and IT architects who architect, evaluate, install, or manage critical computing systems. It is suggested that participants have basic familiarity with LSB style startup scripts, shell scripting and XML. Familiarity with high availability concepts is not assumed. This tutorial provides participants with both basic theory of high-availability systems and practical knowledge of how to plan for and install and configure highly-available systems using Linux-HA.

Description: The Linux-HA project is the oldest and most powerful open source high-availability (HA) package available - comparing favorably to well-known commercial HA packages. Although the project is called Linux-HA (or "heartbeat"), it runs on a variety of POSIX-like systems including FreeBSD Solaris, and OS/X.

Linux-HA provides highly available services on clusters from one to more than 16 nodes with no single point of failure. These services and the servers they run on are monitored. If a service should fail to operate correctly, or a server should fail, the affected services will be quickly restarted or migrated to another server, dramatically improving service availability.

Linux-HA supports for rules for expressing dependencies between services, and powerful rules for locating services in the cluster. Because these services are derived from init service scripts, they are familiar to system administrators and easy to configure and manage. This tutorial will cover planning, installing, and configuring Linux-HA clusters. Topics covered will include:

General HA principles
Installation of the software
Overview of Linux-HA configuration
Overview of commonly used resource agents
Managing services supplied with init(8) scripts
Sample Linux-HA configurations for Apache, NFS, DHCP, DNS and Samba
Writing and testing resource agents conforming to the OCF specification
Creating detailed resource dependencies
Creating co-location constraints
Writing resource location constraints
Causing failovers on user-defined conditions

Read more about this video…

Want to control this feed contents? Sign up here and create your own feed!

Want more on these topics?
Browse the archive of posts filed under OS, Conferences, Broadcasting, Networking, Linux, LinuxConf.AU, Lectures, TCP/IP, DNS

LinuxConf.Au: Managing enterprise data-centers with openQRM

scoundrel — Sat, 10 Mar 2007 18:15:45 GMT

High-availability, scalability, fast and flexible deployment, service- and server-virtualization are the most serious key-parameters for modern, enterprise data-centers today. This new, open-source projects intentions is to combine and integrate all kinds of useful system management tools within a unified and generic data-center management User-interface.

openQRM is an open source system management platform which integrates existing components to manage enterprise data centers efficiently. Its architecture extends to and embraces other existing data center technologies through plug-ins. The out-of-the-box functions include, but are not limited to, provisioning, monitoring, reporting and high availability. Other functionality and integration with third-party software like VMWare, Xen, Linux-VServer and Qemu as partitioning technologies, ldap-Authentication, Iscsi (booting from Iscsi-targets) and more are available.

openQRM manages physical servers and virtual machines, seamlessly and automatically. It assigns server-resources to applications according to defined policies, dynamically adjusts the amount of allocated servers according to actual usage and provides high availability for enterprise services and applications. A secure web interface, which provides easy management and control, combined with powerful command line tools allows to deploy servers and services with a single mouse-click. In the openQRM-server a generic, logical layer, called partition engine, conforms all different kinds of virtualization technologies. This partition-engine provides a virtualized server-resource from the type partition which is then used in the same way as a physical system.

This presentation deals with common aspects and features of openQRM and gives a detailed overview of its capabilities and flexibility in managing enterprise data-centers. It covers its open-source license model and the community, build- and installation of the openQRM-server, management of the available resources, provisioning and high-availability, explains the pluggable architecture and gives examples how various plug-ins are enhancing the functionality of the server and GUI.

Read more about this video…

Want to control this feed contents? Sign up here and create your own feed!

Want more on these topics?
Browse the archive of posts filed under OS, Conferences, Broadcasting, Linux, LinuxConf.AU, Lectures

BigTable: A Distributed Structured Storage System

scoundrel — Tue, 20 Feb 2007 19:38:06 GMT

In this lecture at the University of Washington, Google's Jeff Dean discusses the Bigtable content storage system used in Google's backend.

Read more about this video…

Want to control this feed contents? Sign up here and create your own feed!

Want more on these topics?
Browse the archive of posts filed under Conferences, Companies, Development, Broadcasting, Networking, Techtalks, Google, Lectures

Setting up and Running Amazon EC2 from Windows

scoundrel — Sat, 27 Jan 2007 17:27:09 GMT

A video that walks through the process of running an Amazon Machine Image (AMI) from Windows.

See the Getting Started Guide and the related technical documentation for a written version of these steps. Also, check out the attached transcript of the video, courtesy of CastingWords and Amazon Mechanical Turk.

Read more about this video…

Want to control this feed contents? Sign up here and create your own feed!

Want more on these topics?
Browse the archive of posts filed under OS, Companies, Networking, Windows, Amazon