org.apache.nutch.fetcher
Class FetcherOutputFormat
java.lang.Object
org.apache.nutch.fetcher.FetcherOutputFormat
- All Implemented Interfaces:
- org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>
public class FetcherOutputFormat
- extends Object
- implements org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>
Splits FetcherOutput entries into multiple map files.
Method Summary |
void |
checkOutputSpecs(org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.mapred.JobConf job)
|
org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.Text,NutchWritable> |
getRecordWriter(org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.mapred.JobConf job,
String name,
org.apache.hadoop.util.Progressable progress)
|
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
FetcherOutputFormat
public FetcherOutputFormat()
checkOutputSpecs
public void checkOutputSpecs(org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.mapred.JobConf job)
throws IOException
- Specified by:
checkOutputSpecs
in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>
- Throws:
IOException
getRecordWriter
public org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.Text,NutchWritable> getRecordWriter(org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.mapred.JobConf job,
String name,
org.apache.hadoop.util.Progressable progress)
throws IOException
- Specified by:
getRecordWriter
in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,NutchWritable>
- Throws:
IOException
Copyright © 2006 The Apache Software Foundation