独立运行Apache Atlas

Question

我正在尝试在Ubuntu上以独立的方式运行Apache地图集 - 这意味着不必设置Solr和/或HBase。我所做的（根据文档：http://atlas.apache.org/0.8.1/InstallationSteps.html）是克隆Git存储库，使用mbadded的HBase和dSolr构建maven项目：

mvn clean package -Pdist,embedded-hbase-solr

解压缩了 resuting tar.gz 文件并执行了 bin/atlas_start.py - 无需更改任何配置。根据我对纪录片的理解，实际上应该与阿特拉斯一起启动HBase -对吧？

这是我在日志/应用程序定位中找到的内容.log：

2017-11-30 17:14:24,093 INFO  - [main:] ~ >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> (Atlas:216)
2017-11-30 17:14:24,093 INFO  - [main:] ~ Server starting with TLS ? false on port 21000 (Atlas:217)
2017-11-30 17:14:24,093 INFO  - [main:] ~ <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< (Atlas:218)
2017-11-30 17:14:27,684 INFO  - [main:] ~ No authentication method configured.  Defaulting to simple authentication (LoginProcessor:102)
2017-11-30 17:14:28,527 INFO  - [main:] ~ Logged in user daniel (auth:SIMPLE) (LoginProcessor:77)
2017-11-30 17:14:31,777 INFO  - [main:] ~ Not running setup per configuration atlas.server.run.setup.on.start. (SetupSteps$SetupRequired:189)
2017-11-30 17:14:39,456 WARN  - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (ClientCnxn$SendThread:110$
java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2017-11-30 17:14:39,594 WARN  - [main:] ~ Possibly transient ZooKeeper, quorum=localhost:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = Connecti$
2017-11-30 17:14:40,593 WARN  - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (ClientCnxn$SendThread:110$
java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

...

        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2017-11-30 17:14:56,185 WARN  - [main:] ~ Possibly transient ZooKeeper, quorum=localhost:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = Connecti$
2017-11-30 17:14:56,186 ERROR - [main:] ~ ZooKeeper exists failed after 4 attempts (RecoverableZooKeeper:277)
2017-11-30 17:14:56,186 WARN  - [main:] ~ hconnection-0x1dba4e060x0, quorum=localhost:2181, baseZNode=/hbase Unable to set watcher on znode (/hbase/hbaseid) (ZKUtil:544)
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
        at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:221)
        at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:541)
        at org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:65)

对我来说，它读起来好像没有HBase（和动物园管理员）是由脚本启动的。

我错过了什么吗？

谢谢你的提示！

Answer 1

有两种方法可以运行阿帕奇地图集：

a)从头开始构建:

1. git clone https://github.com/apache/atlas
2. mvn clean install -DskipTests
3. mvn clean package -Pdist -DskipTests
4. Running atlas_start.py:

   python <atlas-directory>/conf/atlas_start.py
   

   b)使用docker图像:

   docker-compose.yml接口

   version: "3.3"
   
   services:
     atlas:
       image: sburn/apache-atlas
       container_name: atlas
       ports:
         - "21000:21000"
       volumes:
         - "./bash_script:/app"
       command: bash -exc "/opt/apache-atlas-2.1.0/bin/atlas_start.py"
   

   docker-compose up
   

Answer 2

好吧，与此同时，我找到了问题。启动脚本显然不执行脚本 conf/atlas-env.sh 它设置了一些环境变量。其中包括MANAGE_LOCAL_HBASE和MANAGE_LOCAL_SOLR。因此，如果您将这两个 env 变量设置为 true（并正确设置JAVA_HOME嵌入式 HBase 所需的值），则 Atlas 会自动启动 HBase 和 Solr - 我们得到一个本地运行的阿特拉斯实例！

也许这有助于将来遇到相同问题的人！