Difference between revisions of "Setting up Gearman"

From Dreamwidth Notes
Jump to: navigation, search
(For Dreamhacks: s/sophie/mark/ where appropriate)
(4 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 +
==About==
 +
An asynchronous job scheduling engine, of the type "do this somewhere else". Benefits: somewhere else, fast. Flaws: currently if it dies jobs are lost (apparently the team that manages it is working on that). Name is an anagram of "manager"; from LiveJournal days.
 +
* [http://azurelunatic.dreamwidth.org/6323528.html IRC log with history/discussion]
 +
* [[Production_Notes#Gearman|Gearman on Dreamwidth]]
 +
* [http://gearman.org/ gearman.org]
 +
 +
==Setup==
 +
 
Install the server:
 
Install the server:
  
 
  sudo apt-get install gearman-server
 
  sudo apt-get install gearman-server
 +
 +
And also edit <tt>/etc/default/gearman-server</tt> so that ENABLED is true.
  
 
Run the daemon:
 
Run the daemon:
Line 9: Line 19:
 
Might want to add it to startup.
 
Might want to add it to startup.
  
Then, you need to add this to your configs in the LJ section somewhere:
+
==For Dreamhacks==
 +
 
 +
If you don't have root, you will need to install the Gearman server locally instead of using the above instructions.
 +
 
 +
cd $LJHOME
 +
mkdir -p extlib
 +
cpanm -n -Lextlib Gearman::Server
 +
 
 +
Then to run the server:
 +
 
 +
perl -Iextlib/lib/perl5 extlib/bin/gearmand --port=[choose a port number] &
 +
 
 +
Ask Mark if you need help figuring out which port number you should use for your Gearman server.
 +
 
 +
==Using Gearman with DW==
 +
 
 +
Once you have Gearman running, you need to add this to your configs in the LJ section somewhere:
 +
 
 +
@GEARMAN_SERVERS = ('localhost:7003');
 +
 
 +
Port 7003 is the default port for a gearman server running as root; dreamhack users should instead use their port number as chosen above.
  
@GEARMAN_SERVERS = ('localhost:7003');
+
When looking for examples of gearman workers in existing code, try:  
  
 +
egrep -i gearman bin/worker/*
 
[[Category: Dreamwidth Installation]]
 
[[Category: Dreamwidth Installation]]

Revision as of 02:46, 11 December 2018

About

An asynchronous job scheduling engine, of the type "do this somewhere else". Benefits: somewhere else, fast. Flaws: currently if it dies jobs are lost (apparently the team that manages it is working on that). Name is an anagram of "manager"; from LiveJournal days.

Setup

Install the server:

sudo apt-get install gearman-server

And also edit /etc/default/gearman-server so that ENABLED is true.

Run the daemon:

sudo /etc/init.d/gearman-server start

Might want to add it to startup.

For Dreamhacks

If you don't have root, you will need to install the Gearman server locally instead of using the above instructions.

cd $LJHOME
mkdir -p extlib
cpanm -n -Lextlib Gearman::Server

Then to run the server:

perl -Iextlib/lib/perl5 extlib/bin/gearmand --port=[choose a port number] &

Ask Mark if you need help figuring out which port number you should use for your Gearman server.

Using Gearman with DW

Once you have Gearman running, you need to add this to your configs in the LJ section somewhere:

@GEARMAN_SERVERS = ('localhost:7003');

Port 7003 is the default port for a gearman server running as root; dreamhack users should instead use their port number as chosen above.

When looking for examples of gearman workers in existing code, try:

egrep -i gearman bin/worker/*