cascading.tap.hadoop
Class TempHfs

java.lang.Object
  extended by cascading.tap.Tap<JobConf,RecordReader,OutputCollector>
      extended by cascading.tap.hadoop.Hfs
          extended by cascading.tap.hadoop.TempHfs
All Implemented Interfaces:
FlowElement, java.io.Serializable

public class TempHfs
extends Hfs

Class TempHfs creates a temporary Tap instance for use internally.

See Also:
Serialized Form

Field Summary
 
Fields inherited from class cascading.tap.hadoop.Hfs
LOCAL_MODE_SCHEME, TEMPORARY_DIRECTORY
 
Constructor Summary
TempHfs(java.lang.String name)
          Constructor TempHfs creates a new TempHfs instance.
TempHfs(java.lang.String name, boolean isNull)
          Constructor TempHfs creates a new TempHfs instance.
TempHfs(java.lang.String name, java.lang.Class schemeClass)
          Constructor TempDfs creates a new TempDfs instance.
 
Method Summary
 boolean deleteResource(JobConf conf)
          Method deleteResource deletes the resource represented by this instance.
 boolean equals(java.lang.Object object)
           
 java.lang.Class getSchemeClass()
           
 java.net.URI getURIScheme(JobConf jobConf)
           
 int hashCode()
           
 boolean isTemporary()
          Method isTemporary returns true if this Tap is temporary (used for intermediate results).
 Scope outgoingScopeFor(java.util.Set<Scope> incoming)
          Method outgoingScopeFor returns the Scope this FlowElement hands off to the next FlowElement.
 void sinkConfInit(FlowProcess<JobConf> process, JobConf conf)
          Method sinkInit initializes this instance as a sink.
 void sourceConfInit(FlowProcess<JobConf> process, JobConf conf)
          Method sourceInit initializes this instance as a source.
 java.lang.String toString()
           
 
Methods inherited from class cascading.tap.hadoop.Hfs
commitResource, createResource, getBlockSize, getChildIdentifiers, getDefaultFileSystem, getDefaultFileSystemURIScheme, getFileSystem, getFullIdentifier, getIdentifier, getLocalModeScheme, getModifiedTime, getPath, getReplication, getSize, getTemporaryDirectory, getTempPath, isDirectory, makeTemporaryPathDirString, makeURIScheme, openForRead, openForWrite, resourceExists, setLocalModeScheme, setStringPath, setTemporaryDirectory, setUriScheme
 
Methods inherited from class cascading.tap.Tap
flowConfInit, getConfigDef, getScheme, getSinkFields, getSinkMode, getSourceFields, getStepConfigDef, getTrace, hasConfigDef, hasProcessConfigDef, isEquivalentTo, isKeep, isReplace, isSink, isSource, isUpdate, openForRead, openForWrite, presentSinkFields, presentSourceFields, resolveFields, resolveIncomingOperationFields, retrieveSinkFields, retrieveSourceFields, rollbackResource, setScheme, taps
 
Methods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, wait
 

Constructor Detail

TempHfs

public TempHfs(java.lang.String name)
Constructor TempHfs creates a new TempHfs instance.

Parameters:
name - of type String

TempHfs

public TempHfs(java.lang.String name,
               boolean isNull)
Constructor TempHfs creates a new TempHfs instance.

Parameters:
name - of type String
isNull - of type boolean

TempHfs

public TempHfs(java.lang.String name,
               java.lang.Class schemeClass)
Constructor TempDfs creates a new TempDfs instance.

Parameters:
name - of type String
Method Detail

getSchemeClass

public java.lang.Class getSchemeClass()

getURIScheme

public java.net.URI getURIScheme(JobConf jobConf)
Overrides:
getURIScheme in class Hfs

outgoingScopeFor

public Scope outgoingScopeFor(java.util.Set<Scope> incoming)
Description copied from interface: FlowElement
Method outgoingScopeFor returns the Scope this FlowElement hands off to the next FlowElement.

Specified by:
outgoingScopeFor in interface FlowElement
Overrides:
outgoingScopeFor in class Tap<JobConf,RecordReader,OutputCollector>
Parameters:
incoming - of type Set
Returns:
Scope

sourceConfInit

public void sourceConfInit(FlowProcess<JobConf> process,
                           JobConf conf)
Description copied from class: Tap
Method sourceInit initializes this instance as a source.

This method maybe called more than once if this Tap instance is used outside the scope of a Flow instance or if it participates in multiple times in a given Flow or across different Flows in a Cascade.

In the context of a Flow, it will be called after FlowListener.onStarting(cascading.flow.Flow)

Overrides:
sourceConfInit in class Hfs
conf - of type JobConf @throws IOException on resource initialization failure.

sinkConfInit

public void sinkConfInit(FlowProcess<JobConf> process,
                         JobConf conf)
Description copied from class: Tap
Method sinkInit initializes this instance as a sink.

This method maybe called more than once if this Tap instance is used outside the scope of a Flow instance or if it participates in multiple times in a given Flow or across different Flows in a Cascade.

Note this method will be called in context of this Tap being used as a traditional 'sink' and as a 'trap'.

In the context of a Flow, it will be called after FlowListener.onStarting(cascading.flow.Flow)

Overrides:
sinkConfInit in class Hfs
conf - of type JobConf @throws IOException on resource initialization failure.

deleteResource

public boolean deleteResource(JobConf conf)
                       throws java.io.IOException
Description copied from class: Tap
Method deleteResource deletes the resource represented by this instance.

Overrides:
deleteResource in class Hfs
Parameters:
conf - of type JobConf
Returns:
boolean
Throws:
java.io.IOException - when the resource cannot be deleted

isTemporary

public boolean isTemporary()
Description copied from class: Tap
Method isTemporary returns true if this Tap is temporary (used for intermediate results).

Overrides:
isTemporary in class Tap<JobConf,RecordReader,OutputCollector>
Returns:
the temporary (type boolean) of this Tap object.

toString

public java.lang.String toString()
Overrides:
toString in class Hfs

equals

public boolean equals(java.lang.Object object)
Overrides:
equals in class Hfs

hashCode

public int hashCode()
Overrides:
hashCode in class Hfs


Copyright © 2007-2011 Concurrent, Inc. All Rights Reserved.