RuntimeError:使用Tweepy收集推文时，超出了cmp '中的最大递归深度

Question

我试图使用 tweepy 从推特 api 收集大量推文。我有一个包含大约一万个推文ID的文本文件。我的程序通读文件，抓取每条推文，以及它正在回复的推文。然后，它将每条推文的文本以及每个作者的用户名保存在相应的文本文件中。代码如下：

auth = tweepy.OAuthHandler(ckey, csecret)
auth.set_access_token(atoken, asecret)

api = tweepy.API(auth)

tweetsFile = open("srcstic.txt", "r")
tweets_seen = set() # holds tweets already seen

def getNextLine():
    while True:

        tweetID = tweetsFile.readline()
        getTweetObj(tweetID)

        if not tweetID:
            break

def getTweetObj(tweetID):
    try:
        tweetObj = api.get_status(tweetID)
        #sleep(11)
    except tweepy.error.TweepError:
        getNextLine()
    else:
        pass
    tweet = tweetObj.text.encode("utf8")
    idnum = tweetObj.in_reply_to_status_id_str

    try:
        former = api.get_status(idnum)
    except tweepy.error.TweepError:
        getNextLine()
    else:
        printFiles(former, tweetObj, tweet)

def printFiles(former, tweetObj, tweet):

    callUserName = former.user.screen_name
    responseUserName = tweetObj.user.screen_name

    if tweet not in tweets_seen:

        with open("callauthors.txt", "a") as callauthors:
                cauthors = callUserName + "\n"
                callauthors.write(cauthors)

        with open("responseauthors.txt", "a") as responseauthors:
                rauthors = responseUserName + "\n"
                responseauthors.write(rauthors)

        with open("response_tweets.txt", "a") as responsetweets:
                output = (tweetObj.text.encode('utf-8')+"\n")
                responsetweets.write(output)

        with open("call_tweets.txt", "a") as calltweets:
                output = (former.text.encode('utf-8')+"\n")
                calltweets.write(output)
                tweets_seen.add(tweet)

    getNextLine()

但是，暂时一切正常，然后我得到以下错误:

 File "gettweets2.py", line 68, in <module>
getNextLine()
  File "gettweets2.py", line 21, in getNextLine
getTweetObj(tweetID)
  File "gettweets2.py", line 40, in getTweetObj
getNextLine()
  File "gettweets2.py", line 21, in getNextLine
getTweetObj(tweetID)
  File "gettweets2.py", line 31, in getTweetObj
getNextLine()
  File "gettweets2.py", line 21, in getNextLine
getTweetObj(tweetID)
  File "gettweets2.py", line 31, in getTweetObj
getNextLine()
  File "gettweets2.py", line 21, in getNextLine
getTweetObj(tweetID)
  File "gettweets2.py", line 31, in getTweetObj
getNextLine()
........
........
  File         "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/_    abcoll.py", line 540, in update
if isinstance(other, Mapping):
  File     "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/abc.py", line 141, in __instancecheck__
subtype in cls._abc_negative_cache):
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/_weakrefset.py", line 73, in __contains__
return wr in self.data
RuntimeError: maximum recursion depth exceeded in cmp

知道这里出了什么问题吗？谢谢。

Answer 1

正如我所能理解的，读取错误会使您陷入无限递归，因为每个例程都调用另一个例程。如果获取下一行不能使您摆脱错误条件，您将在不到一秒的时间内超过堆栈限制。

如果没有别的，就用几个print语句做一个快速检查:在遇到tweetIDs时打印出来，并贴上标签以标识打印位置。直接修复很可能包括编写第二个例程来获取原始推文，而没有重现的能力。这假设您只需要当前tweet的直接父节点，而不是整个链。

Answer 2

您只能递归地调用函数999次，之后您会收到该错误。相反，您可以使用条件语句从函数外部调用或创建生成器。