java udf for pig_java-Apache Pig UDF解决问题

我有以下Java代码(返回固定值进行测试)：

静态文件

package com.company;

import java.io.IOException;

import org.apache.pig.EvalFunc;

import org.apache.pig.data.Tuple;

import org.apache.pig.impl.util.WrappedIOException;

public class Static extends EvalFunc

{

public String exec(Tuple input) throws IOException

{

if (input == null || input.size() == 0)

return null;

try

{

String str = (String)input.get(0);

return "5876L";

}

catch (Exception e)

{

throw WrappedIOException.wrap("Caught exception processing input row ", e);

}

}

}

内置使用

javac -Xbootclasspath:/usr/lib/jvm/j2sdk1.6-oracle/jre/lib/rt.jar -source 1.6 -cp `hadoop classpath`:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/pig/pig-0.11.0-cdh4.3.0.jar Static.java

jar -cf Static.jar Static.class

Apache Pig工作

REGISTER /path/to/Static.jar;

loaded = LOAD 'data/' USING com.twitter.elephantbird.pig.store.LzoPigStorage() AS (line:chararray);

loaded = SAMPLE loaded 0.00001;

sized = FOREACH loaded GENERATE com.company.Static(line);

DUMP sized;

与跑

# pig -f static.pig -x local

哪些错误

[main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1070: Could not resolve com.company.Static using imports: [, org.apache.pig.builtin., org.apache.pig.impl.builtin.]

换线

sized = FOREACH loaded GENERATE com.company.Static(line);

至

sized = FOREACH loaded GENERATE Static(request);

与错误

[main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. Static (wrong name: com/company/Static)

解决方法:

您似乎在jar中缺少必需的目录结构. com.company.Static(即Static.class文件)应位于jar的com / company目录下.有关更多详细信息,请参见其他SO question.

标签：hadoop,apache-pig,java

来源： https://codeday.me/bug/20191122/2061790.html