Skip to content

moretv/cobweb

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

cobweb

a distributed task execution system

  • easy to dispatch task script and autoreload

  • multi-process task model

  • multi-thread task running

  • support task parameter router

          pidFile = "cw.pid"
          hostName = "TestHost"
          logFile = "cobweb.log"
          logLevel = 0 # if logLevel > 0 then run as a daemon
    
          taskList = [
              {
                  "dictString" : "ThankYouForChoosingMoreTV",
                  "indexUrl" : "http://127.0.0.1:8080/cobweb/index",
                  "downloadUrl" : "http://127.0.0.1:8080/cobweb/download",
                  "taskFreq" : 5, # Option
                  "indexFreq" : 15, # Option        
                  "taskUrl" : "http://127.0.0.1:8080/cobweb/parameter",  # Option
                  "resultUrl" : "http://127.0.0.1:8080/cobweb/result", # Option
              }
          ]
    
          ############################
    
          import Cobweb.Process
          import Cobweb.Thread
          import Cobweb.Utiles
    
          Logger = Cobweb.Utiles.Logger(logFile, logLevel)
          Daemon = Cobweb.Process.Daemon(pidFile, Logger)
    
          try:
              if 0 == logLevel:
                  import time
                  for task in taskList:
                      Cobweb.Thread.Tasks(task, hostName, Logger).start()
                  while True: time.sleep(9999)
              else:
                  for task in taskList:
                      Daemon.start(Cobweb.Thread.Tasks(task, hostName, Logger))
          except (IOError,EOFError,KeyboardInterrupt):
              Daemon.killAll()
              exit(0)
    

About

Distributed task execution system

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages