DataStax has released Brisk 1.0 Beta 2! You can download Brisk from the DataStax web site.
New Features in Brisk 1.0 Beta 2
The following new features have been added in this release:
Feature |
Description |
|
BRISK-12 |
Apache Pig Integration. See the DataStax Documentation for more information about using Pig in Brisk. |
|
BRISK-89 |
Job Tracker Failover. See the DataStax Documentation for more information about using the new brisktool movejt command. |
|
BRISK-207 |
New Snappy Compression Codec built on Google Snappy is now used internally for automatic CassandraFS block compression. |
|
Automap Cassandra Column Families to Hive Tables in the Brisk Hive Metastore. |
|
|
Add a second HDFS layer in CassandraFS for long-term data storage. This is needed because the blocks column family in CFS requires frequent compactions - Hadoop uses it during MapReduce processing to store small files and temporary data. Compaction cleans this temporary data up after it is not needed anymore. Now there is the cfs:/// and cfs-archive:/// endpoints within CFS. The blocks column family in cfs-archive:/// has compaction disabled to improve performance for static data stored in CFS. |
Major Fixes in Brisk 1.0 Beta 2
Brisk 1.0 Beta 2 also incudes the following major fixes. For details on all fixes in Beta 2, see the Brisk Jira Project Web site:
Issue |
Description |
|
BRISK-126 |
Remove multiple slf4j warnings |
|
BRISK-203 |
Use batchMutate instead of insert in HiveCassandraOutputFormat |
|
BRISK-219 |
Cassandra super columns not mapping in Hive |
|
BRISK-220 |
Improve performance of hadoop fs -ls |
|
CASSANDRA-2683 |
Compaction issue causing secondary index corruption. |
Open Issues
For a description of the open issues in Brisk, see the Brisk Jira Project Web site.
About Brisk
Brisk is an open-source Hadoop and Hive distribution developed by DataStax that utilizes Apache Cassandra for its core services and storage. Brisk provides Hadoop MapReduce capabilities using CassandraFS, an HDFS-compatible storage layer inside Cassandra. By replacing HDFS with CassandraFS, users are able to leverage their current MapReduce jobs on Cassandra’s peer-to-peer, fault-tolerant, and scalable architecture. Brisk is also able to support dual workloads, allowing you to use the same cluster of machines for both real-time applications and data analytics without having to move the data around between systems.
Brisk is available via Apache license v2.0, and contains the following components:
- Apache Hadoop 0.20.203.0 + (HADOOP-7172, HADOOP-5759, HADOOP-7255)
- Cassandra 0.8.1
- Apache Hive 0.7
- Apache Pig 0.8.3
