Setting up Gearman

From Dreamwidth Notes
(Redirected from Gearman)
Jump to: navigation, search

About

An asynchronous job scheduling engine, of the type "do this somewhere else". Benefits: somewhere else, fast. Flaws: currently if it dies jobs are lost (apparently the team that manages it is working on that). Name is an anagram of "manager"; from LiveJournal days.

Setup

Install the server:

sudo apt-get install gearman-server

And also edit /etc/default/gearman-server so that ENABLED is true.

Run the daemon:

sudo /etc/init.d/gearman-server start

Might want to add it to startup.

For Dreamhacks

If you don't have root, you will need to install the Gearman server locally instead of using the above instructions.

cd $LJHOME
mkdir -p extlib
cpanm -n -Lextlib Gearman::Server

Then to run the server:

perl -Iextlib/lib/perl5 extlib/bin/gearmand --port=[choose a port number] &

Ask Mark if you need help figuring out which port number you should use for your Gearman server.

Using Gearman with DW

Once you have Gearman running, you need to add this to your configs in the LJ section somewhere:

@GEARMAN_SERVERS = ('localhost:7003');

Port 7003 is[*] the default port for a gearman server running as root; dreamhack users should instead use their port number as chosen above.

[*] Note: in fact, the default port for Gearman was changed to 4730 in early 2009 by IANA, but Dreamwidth continues to use 7003 in production for historical reasons. Admins of newer installations will probably want to specify localhost:4730 instead.

When looking for examples of gearman workers in existing code, try:

egrep -i gearman bin/worker/*