Oozie is a workflow scheduler system to manage Apache Hadoop jobs.
Oozie Workflow jobs are Directed Acyclical Graphs (DAGs) of actions.
Oozie Coordinator jobs are recurrent Oozie Workflow jobs triggered by time
(frequency) and data availabilty.
Oozie is integrated with the rest of the Hadoop stack supporting several types
of Hadoop jobs out of the box (such as Java map-reduce, Streaming map-reduce,
Pig, Hive, Sqoop and Distcp) as well as system specific jobs (such as
Java programs and shell scripts).
Oozie is a scalable, reliable and extensible system.
Open BEAGLE is a C++ Evolutionary Computation (EC) framework. It provides an
high-level software environment to do any kind of EC, with support for
tree-based genetic programming, bit string and real-valued genetic algorithms,
and evolution strategy.
The Open BEAGLE architecture follows strong principles of object oriented
programming, where abstractions are represented by loosely coupled objects and
where it is common and easy to reuse code. Open BEAGLE is designed to provide
an EC environment that is generic, user friendly, portable, efficient, robust,
elegant and free.
NetBSD's version of mkdep.
Because it is a C program and does all postprocessing and file
handling without calling any external programs, it is up to 10-percent
faster than the original BSD mkdep shell script.
Also it contains options not available in FreeBSD's mkdep.
OpenZz is a dynamic parser which allows its grammar to be extended by
commands written in its own Zz language. Due to the interpreted and
dynamic nature of the parser OpenZz can be used to develop both fast
language prototypes and full compilers.
Apache Pig is a platform for analyzing large data sets that consists of a
high-level language for expressing data analysis programs, coupled with
infrastructure for evaluating these programs. The salient property of Pig
programs is that their structure is amenable to substantial parallelization,
which in turns enables them to handle very large data sets.
At the present time, Pig's infrastructure layer consists of a compiler that
produces sequences of Map-Reduce programs, for which large-scale parallel
implementations already exist (e.g., the Hadoop subproject). Pig's language
layer currently consists of a textual language called Pig Latin, which has
the following key properties:
-- Ease of programming. It is trivial to achieve parallel execution of simple,
"embarrassingly parallel" data analysis tasks. Complex tasks comprised of
multiple interrelated data transformations are explicitly encoded as data flow
sequences, making them easy to write, understand, and maintain.
-- Optimization opportunities. The way in which tasks are encoded permits the
system to optimize their execution automatically, allowing the user to focus
on semantics rather than efficiency.
-- Extensibility. Users can create their own functions to do special-purpose
processing.
It's a library for doing evolutionary computation in Perl.
Algorithm::Evolutionary was formerly called OPEAL, which is an acronym for
Obvious Pearl Evolutionary Algorithm Library.
The design principles of Algorithm::Evolutionary are:
* It should be easy to program any kind of evolutionary algorithm; all
chromosome representations and operators are possible.
* An XML dialect called EvoSpec is used as a language for description of
algorithms and for representation of the state of an algorithm. This
could make Algorithm::Evolutionary interoperable with other EA libraries,
such as EO or JEO.
ccache is a compiler cache. It acts as a caching pre-processor to C/C++
compilers, using the -E compiler switch and a hash to detect when a
compilation can be satisfied from cache. This often results in a 5 to 10
times speedup in common compilations.
SD is a peer to peer ticket tracking system built on the Prophet distributed
database. SD is designed to make it easy to work with tickets and to share
ticket databases with your collaborators
The Internet Communications Engine (Ice) is a modern alternative to object
middleware such as CORBA(TM) or COM/DCOM/COM+. Ice is easy to learn, yet
provides a powerful network infrastructure for demanding technical applications.
Ice shines where technologies such as SOAP or XML-RPC are too slow, or do not
provide sufficient scalability or security.
DateTime::Format::Natural takes a string with a human readable date/time
and creates a machine readable one by applying natural parsing logic.