git clone https://@opensourceprojects.eu/git/p/osp/osp-allura osp-osp-allura



File Date Author Commit
Allura 2011-01-27 John Hoffmann John Hoffmann [0d6dd4] Merge branch 'jwh/792' into dev
AlluraTesting 2011-01-27 Paul Sokolovsky Paul Sokolovsky <Commit f044670670b945db7e5c494ad976b77626136115> [#1311] Add method to control content validatio...
ForgeBlog 2011-01-13 Rick Copeland Rick Copeland <Commit b428955a584ed071f0e46508993aac4f3fb492b1> [#1289] Revamp permissions for performance
ForgeChat 2011-01-13 Rick Copeland Rick Copeland <Commit b428955a584ed071f0e46508993aac4f3fb492b1> [#1289] Revamp permissions for performance
ForgeDiscussion 2011-01-21 Wolf Wolf <Commit 28036b0a202e7c24e604bcbc003d7751b9bd2825> [#1224] prevent a new forum from being created ...
ForgeDownloads 2011-01-11 Wolf Wolf <Commit 9151c98effe5512d3fb70815046145f0480125a8> Merge branch 'master' into dev
ForgeGit 2011-01-24 Rick Copeland Rick Copeland <Commit 495ed73986e7991b19074d55af08fc0b699bd26d> [#1363] Use ConfigParser to update .hgrc file o...
ForgeHg 2011-01-26 Jenny Steele Jenny Steele <Commit 6e738d12f5e22ff4c851f03165b72f162367be6c> [#1376] SVN and hg index pages now use correct ...
ForgeLink 2011-01-06 Paul Sokolovsky Paul Sokolovsky <Commit ca342b9b03a022687360f10b19e80be6917b709f> [#1260] Elaborate chunk handling for form eleme...
ForgeMail 2011-01-13 Rick Copeland Rick Copeland <Commit 9e3947d2e3bcfc7bc9d77f246ff9ff5e884a3882> [#1237] Add missing test init
ForgeSVN 2011-01-26 Jenny Steele Jenny Steele <Commit 6e738d12f5e22ff4c851f03165b72f162367be6c> [#1376] SVN and hg index pages now use correct ...
ForgeSampleSiteAdmin 2010-12-02 Paul Sokolovsky Paul Sokolovsky <Commit f65ddabbe2447eb910b587ac55fd8d982a041a2b> [#0] Update for pymongo 1.9 (bson is now top-le...
ForgeTracker 2011-01-24 Rick Copeland Rick Copeland <Commit 8a99d2e6c5234118aa38e05638137678b3104224> [#1392] Rework cached ticket search bins so the...
ForgeWiki 2011-01-25 Jenny Steele Jenny Steele <Commit 34207e36096ed9d5587095cf9867eac34e61ae6d> [#1396] Made sure all user icons are using the ...
NoWarnings 2010-09-22 Wolf Wolf <Commit e09d8d9066f53b82954263842398855479c1c6a0> [#793] add BSD license to each package and to t...
migrate-3rdparty 2010-11-16 Paul Sokolovsky Paul Sokolovsky <Commit 287c653d94e84d009c09f403bfd4df09c40f518f> [#1029] Support user mapping on import.
pyforge 2010-08-13 Rick Copeland Rick Copeland <Commit 3abb2e55fdc2bbc9ac316dc4ac9bfe71166737d0> [#176] - s/pyforge(the egg)/Allura/g, s/pyforge...
scripts 2011-01-25 Wolf Wolf <Commit 67a7865e31c03637e606454bf01a05a64ead134a> Specially handle branches with prefixes 'ffa/' ...
solr_config 2010-03-23 Rick Copeland Rick Copeland <Commit 01d9bfb1ddef49835820f1d10b2414ba56703480> [#118] - Testing infrastructure upgrades
.gitignore 2010-08-13 Rick Copeland Rick Copeland <Commit 3abb2e55fdc2bbc9ac316dc4ac9bfe71166737d0> [#176] - s/pyforge(the egg)/Allura/g, s/pyforge...
.gitmodules 2009-12-01 Wolf Wolf <Commit e4830bd691eb52e6ae1e0921b09247bf4ec3aed5> Remove Ming submodule
LICENSE 2010-09-22 Wolf Wolf <Commit e09d8d9066f53b82954263842398855479c1c6a0> [#793] add BSD license to each package and to t...
README.markdown 2011-01-27 John Hoffmann John Hoffmann [0d6dd4] Merge branch 'jwh/792' into dev
rebuild.bash 2011-01-11 Wolf Wolf <Commit 9151c98effe5512d3fb70815046145f0480125a8> Merge branch 'master' into dev
requirements-common.txt 2011-01-27 John Hoffmann John Hoffmann [0d6dd4] Merge branch 'jwh/792' into dev
requirements-dev.txt 2011-01-27 John Hoffmann John Hoffmann [0d6dd4] Merge branch 'jwh/792' into dev
requirements.txt 2011-01-27 John Hoffmann John Hoffmann [0d6dd4] Merge branch 'jwh/792' into dev
run_tests 2010-11-05 Rick Copeland Rick Copeland <Commit f48b10dffe8c8f0492225f32048a524fd9e357e1> [#1030] Some test fixes
schema.xml 2010-02-12 Jenny Steele Jenny Steele <Commit 69d85666fc5c4464ad7a1731231e414fdfc5a965> Merge branch 'master' of ssh://engr.geek.net/forge

Read Me

Sandbox Creation

We'll use VirtualBox and Ubuntu 10.10 to create a disposable sandbox for Forge development/testing.

  • Download and install VirtualBox for your platform.

  • Download a minimal Ubuntu 10.10 ISO (~15MB).

  • Create a new virtual machine in Virtual Box, selecting Ubuntu (64 bit) as the OS type. The rest of the wizards' defaults are fine.

  • When you launch the virtual machine for the first time, you will be prompted to attach your installation media. Browse to the mini.iso that you downloaded earlier.

  • Consult available documentation for help installing Ubuntu.

Forge Installation

Before we begin, you'll need the following additional packages in order to checkout the Forge source code.

~$ sudo apt-get install git-core mercurial

You'll also need additional development packages in order to compile some of the modules.

~$ sudo apt-get install default-jdk python-dev libssl-dev libldap2-dev libsasl2-dev

Running the test suite requires additional packages.

~$ sudo apt-get install libtidy-0.99-0 gitweb

... and our messaging server, RabbitMQ.

~$ sudo apt-get install rabbitmq-server

And finally our document-oriented database, MongoDB.

~$ sudo apt-get install mongodb

Setting up a virtual python environment

The first step to installing the Forge platform is installing a virtual environment via virtualenv. This helps keep our distribution python installation clean.

~$ sudo apt-get install python-setuptools
~$ sudo easy_install-2.6 -U virtualenv

Once you have virtualenv installed, you need to create a virtual environment. We'll call our Forge environment 'anvil'.

~$ virtualenv --no-site-packages anvil

This gives us a nice, clean environment into which we can install all the forge dependencies. In order to use the virtual environment, you'll need to activate it. You'll need to do this whenever you're working on the Forge codebase so you may want to consider adding it to your ~/.bashrc file.

~$ . anvil/bin/activate

Now that that's out of the way, we'll go ahead and install TurboGears.

(anvil)~$ easy_install pylons==0.9.7
(anvil)~$ easy_install -i http://www.turbogears.org/2.1/downloads/2.1b2/index/ tg.devtools==2.1b2 TurboGears2==2.1b2
(anvil)~$ easy_install http://httplib2.googlecode.com/files/httplib2-0.4.0.tar.gz

Installing the Forge code and dependencies

Now we can get down to actually getting the Forge code and dependencies downloaded and ready to go.

(anvil)~$ mkdir src
(anvil)~$ cd src
(anvil)~/src$ git clone git://git.code.sf.net/p/allura/git.git forge

Although the application setup.py files define a number of dependencies, the requirements.txt files are currently the authoritative source, so we'll use those with pip to make sure the correct versions are installed.

(anvil)~/src$ cd forge
(anvil)~/src/forge$ easy_install pip
(anvil)~/src/forge$ pip install -r requirements-dev.txt

And now to setup each of the Forge applications for development. Because there are quite a few (at last count 15), we'll use a simple shell loop to set them up.

for APP in Allura* Forge* NoWarnings pyforge
do
    pushd $APP
    python setup.py develop
    popd
done

Hopefully everything completed without errors. We'll also need to create a place for Forge to store any SCM repositories that a project might create.

for SCM in git svn hg
do
    mkdir -p ~/var/scm/$SCM
    chmod -R 777 ~/var/scm
    sudo ln -s ~/var/scm/$SCM /
done

Initializing the environment

The forge consists of several components, all of which need to be running to have full functionality.

MongoDB database server

Generally set up with its own directory, we'll use ~/var/mongodata to keep our installation localized. We also need to disable the default distribution server.

(anvil)~$ sudo service mongodb stop
(anvil)~$ sudo update-rc.d mongodb remove

(anvil)~$ mkdir -p ~/var/mongodata ~/logs
(anvil)~$ nohup mongod --dbpath ~/var/mongodata > ~/logs/mongodb.log &

SOLR search and indexing server

We have a custom config ready for use.

(anvil)~$ cd ~/src
(anvil)~/src$ wget http://apache.mirrors.tds.net/lucene/solr/1.4.0/apache-solr-1.4.0.tgz
(anvil)~/src$ tar xf apache-solr-1.4.0.tgz
(anvil)~/src$ cd apache-solr-1.4.0/example/
(anvil)~/src/apache-solr-1.4.0/example/$ nohup java -Dsolr.solr.home=$(cd;pwd)/src/forge/solr_config -jar start.jar > ~/logs/solr.log &

RabbitMQ message queue

We'll need to setup some development users and privileges.

(anvil)~$ sudo rabbitmqctl add_user testuser testpw
(anvil)~$ sudo rabbitmqctl add_vhost testvhost
(anvil)~$ sudo rabbitmqctl set_permissions -p testvhost testuser ""  ".*" ".*"

Forge "reactor" processing

Responds to RabbitMQ messages. We'll need to perform some setup operations before we can start it.

(anvil)~$ cd ~/src/forge/Allura
(anvil)~/src/forge/Allura$ paster reactor_setup development.ini
(anvil)~/src/forge/Allura$ nohup paster reactor development.ini > ~/logs/reactor.log &

Forge SMTP for inbound mail

Routes messages from email addresses to tools in the forge.

(anvil)~/src/forge/Allura$ nohup paster smtp_server development.ini > ~/logs/smtp.log &

TurboGears application server

One of the modules we need for Subversion integration is not available in egg format, however the distribution copy will work fine.

(anvil)~$ sudo apt-get install python-svn
(anvil)~$ echo '/usr/lib/python2.6/dist-packages' >> ~/anvil/lib/python2.6/site-packages/setuptools.pth

In order to initialize the forge database, you'll need to run the following:

(anvil)~/src/forge/Allura$ paster setup-app development.ini

This shouldn't take too long, but it will start the reactor server doing tons of stuff in the background. It should complete in 5-6 minutes. Once this is done, you can start the application server.

(anvil)~/src/forge/Allura$ nohup paster serve --reload development.ini > ~/logs/tg.log &

And now you should be able to visit the server running on your local machine.

Next Steps

Generate the documentation

Forge documentation currently lives in the Allura/docs directory and can be converted to HTML using Sphinx:

(anvil)~$ cd ~/src/forge/Allura/docs
(anvil)~/src/forge/Allura/docs$ easy_install sphinx
(anvil)~/src/forge/Allura/docs$ make html

You will also want to give the test suite a run, to verify there were no problems with the installation.

(anvil)~$ cd ~/src/forge
(anvil)~/src/forge$ ./run_tests

Happy hacking!

Current Local Tweaks

[#1405] Remove sf.phpsession from forge/Allura/setup.py

diff --git a/Allura/setup.py b/Allura/setup.py
index f9fc0c4..ea1eb16 100644
--- a/Allura/setup.py
+++ b/Allura/setup.py
@@ -37,7 +37,6 @@ setup(
         "EasyWidgets >= 0.1.1",
         "PIL >= 1.1.7",
         "iso8601",
-        "sf.phpsession==0.1",
         "chardet==1.0.1",
         "feedparser>=4.1,<=4.2",
         "oauth2==1.2.0",

[#1407] Remove all rtstats traces from Allura/development.ini

 diff --git a/Allura/development.ini b/Allura/development.ini
 index 71c3166..0496619 100644
 --- a/Allura/development.ini
 +++ b/Allura/development.ini
 @@ -184,15 +184,15 @@ templating.mako.reloadfromdisk = true
  keys = root, allura, sqlalchemy, paste, amqp

  [handlers]
 -keys = console, rtstats
 +keys = console

  [formatters]
 -keys = generic, rtstats
 +keys = generic

  # If you create additional loggers, add them as a key to [loggers]
  [logger_root]
  level = DEBUG
 -handlers = console, rtstats
 +handlers = console

  [logger_allura]
  level = DEBUG
 @@ -224,17 +224,7 @@ args = (sys.stderr,)
  level = NOTSET
  formatter = generic

 -[handler_rtstats]
 -class = sfx.lib.loggers.RTStatsHandler
 -args = ('rtstats.log', 'allura', 1)
 -level = NOTSET
 -formatter = rtstats
 -
  # If you create additional formatters, add them as a key to [formatters]
  [formatter_generic]
  format = %(asctime)s,%(msecs)03d %(levelname)-5.5s [%(name)s] %(message)s
  datefmt = %H:%M:%S
 -
 -[formatter_rtstats]
 -format = %(asctime)s %(created)d %(kwpairs)s
 -datefmt = %d/%b/%Y:%H:%M:%S UTC