用apache spark为cassandra插入创建timeuuid

Question

CREATE TABLE leech_seed_report.daily_sessions (
    id timeuuid PRIMARY KEY,
    app int,
    count int,
    date bigint,
    offline boolean,
    vendor text,
    version text
) WITH bloom_filter_fp_chance = 0.01
    AND caching = '{"keys":"ALL", "rows_per_partition":"NONE"}'
    AND comment = ''
    AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'}
    AND compression = {'sstable_compression': 'org.apache.cassandra.io.compress.LZ4Compressor'}
    AND dclocal_read_repair_chance = 0.1
    AND default_time_to_live = 0
    AND gc_grace_seconds = 864000
    AND max_index_interval = 2048
    AND memtable_flush_period_in_ms = 0
    AND min_index_interval = 128
    AND read_repair_chance = 0.0
    AND speculative_retry = '99.0PERCENTILE';
CREATE INDEX daily_sessions_app_idx ON leech_seed_report.daily_sessions (app);
CREATE INDEX daily_sessions_date_idx ON leech_seed_report.daily_sessions (date);
CREATE INDEX daily_sessions_offline_idx ON leech_seed_report.daily_sessions (offline);
CREATE INDEX daily_sessions_vendor_idx ON leech_seed_report.daily_sessions (vendor);
CREATE INDEX daily_sessions_version_idx ON leech_seed_report.daily_sessions (version);

rows.saveToCassandra("leech_seed_report", "daily_sessions", SomeColumns("id", "date", "app", "vendor", "version", "offline", "count"))

([timmuuid_will_be_here], BigInt, Int, String, String, Boolean, Int)

Answer 1

最后，我尝试按照zero323的建议使用UUIDGen，但是我得到了一个错误，我认为这是由于缺少依赖关系，但是我是一个scala新手，无法确定。经过一点研究，这似乎是我应该走的路，但当我有更多的时间/经验时，我会回到它。

我使用gfc-timeuuid完成了spark工作并生成了timeuuid，只需将以下内容添加到build.sbt文件中即可

libraryDependencies += "com.gilt" %% "gfc-timeuuid" % "0.0.5"

然后在scala脚本中执行以下操作

import com.gilt.timeuuid._

val tuuid = TimeUuid()