omz:forum

    • Register
    • Login
    • Search
    • Recent
    • Popular

    Welcome!

    This is the community forum for my apps Pythonista and Editorial.

    For individual support questions, you can also send an email. If you have a very short question or just want to say hello — I'm @olemoritz on Twitter.


    Need to take a One Drive file and upload it to a FTP

    Pythonista
    onedrive ftp
    4
    35
    8886
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Tito
      Tito @cvp last edited by

      @cvp what a pity... in that case I’m have to do it manually forever.

      Thanks for your help. :)

      cvp 1 Reply Last reply Reply Quote 0
      • cvp
        cvp @Tito last edited by

        @Tito said:

        in that case I’m have to do it manually forever.

        Or try via theMS API

        Tito 1 Reply Last reply Reply Quote 0
        • Tito
          Tito @cvp last edited by

          @cvp I’ve found a post about the compatibility between OneDrive and Shortcuts but seems to be only for scan documents and related stuff nothing related to file routes.

          cvp 4 Replies Last reply Reply Quote 0
          • cvp
            cvp @Tito last edited by

            @Tito I had tried also a shortcut opening the url, without success.

            Another solution could be perhaps web scraping on the OneDrive site...but surely not easy.

            1 Reply Last reply Reply Quote 0
            • cvp
              cvp @Tito last edited by cvp

              @Tito I think I have found a solution.
              You have to share (in OneDrive app or web page) your folder once and copy the generated link.

              Then, try this little script, where you have to replace my url with yours

              import ui
              url = 'https://1drv.ms/u/s!AnAqP7kYeMWrgXwwda6qlAmt-bsl?e=wNu7Tb'
              w = ui.WebView()
              w.load_url(url)
              w.present()
              

              You will get a web page where we will still have to find a way to press the download button to get a zip with all files in the folder.

              1 Reply Last reply Reply Quote 0
              • cvp
                cvp @Tito last edited by

                @Tito I'll (try to 🙄)do it this evening

                1 Reply Last reply Reply Quote 0
                • cvp
                  cvp @Tito last edited by cvp

                  @Tito Finally, easier that I thought. For each OneDrive file that you need to upload, in the OneDrive app, once, you share it, and 'copy the link'. In the little script here under, you store in the files dict, the file name name and it's pasted link.
                  Even if the OneDrive file is modified, its link stays the same, at least during my tests.
                  The script downloads the OneDrive file and copies it locally.
                  The FTP unload part is another process, if you want help for it, ask me.

                  Based on Generate OneDrive Direct-Download Link with C# or Python

                  import requests
                  import base64
                  
                  def create_onedrive_directdownload (onedrive_link):
                  	data_bytes64 = base64.b64encode(bytes(onedrive_link, 'utf-8'))
                  	data_bytes64_String = data_bytes64.decode('utf-8').replace('/','_').replace('+','-').rstrip("=")
                  	resultUrl = f"https://api.onedrive.com/v1.0/shares/u!{data_bytes64_String}/root/content"
                  	return resultUrl
                  	
                  def main():
                  	files = {'a.py':'https://1drv.ms/u/s!AnAqP7kYeMWrgX9L-9sMT08Fkgkf', 'aa.txt':'https://1drv.ms/t/s!AnAqP7kYeMWrggCb2Umu3Wn_Hr4G'}
                  	for nam_file in files:
                  		url_file = create_onedrive_directdownload(files[nam_file])
                  		r = requests.get(url_file)
                  		with open(nam_file, mode='wb') as fil:
                  			fil.write(r.content)
                  
                  if __name__ == '__main__':
                  	main()
                  
                  1 Reply Last reply Reply Quote 1
                  • cvp
                    cvp @Tito last edited by cvp

                    @Tito including SFTP

                    import base64
                    import os
                    import paramiko
                    import requests
                    import sys
                    
                    # https://towardsdatascience.com/how-to-get-onedrive-direct-download-link-ecb52a62fee4
                    
                    def create_onedrive_directdownload (onedrive_link):
                    	data_bytes64 = base64.b64encode(bytes(onedrive_link, 'utf-8'))
                    	data_bytes64_String = data_bytes64.decode('utf-8').replace('/','_').replace('+','-').rstrip("=")
                    	resultUrl = f"https://api.onedrive.com/v1.0/shares/u!{data_bytes64_String}/root/content"
                    	return resultUrl
                    		
                    def main():
                    	path = sys.argv[0]
                    	i = path.rfind('/')
                    	path = path[:i+1]
                    	ip = 'my ip'
                    	user = 'user'
                    	pwd = 'password'
                    	try:
                    		sftp_port = 22
                    		transport = paramiko.Transport((ip, sftp_port))
                    		transport.connect(username=user, password=pwd)
                    		sftp = paramiko.SFTPClient.from_transport(transport)
                    		files = {'a.py':'https://1drv.ms/u/s!AnAqP7kYeMWrgX9L-9sMT08F', 'aa.txt':'https://1drv.ms/t/s!AnAqP7kYeMWrggCb2Umu3Wn_'}
                    		for nam_file in files:
                    			url_file = create_onedrive_directdownload(files[nam_file])
                    			r = requests.get(url_file)
                    			with open(nam_file, mode='wb') as fil:
                    				fil.write(r.content)
                    			sftp.put(path + nam_file, nam_file)
                    			os.remove(nam_file)
                    		sftp.close()
                    		transport.close()
                    	except Exception as e:
                    		print(str(e))
                    
                    if __name__ == '__main__':
                    	main()
                    
                    1 Reply Last reply Reply Quote 0
                    • cvp
                      cvp last edited by

                      You could even find automatically the file name from its link

                      .
                      .
                      .
                      		for nam_file in files:
                      			r = requests.get(files[nam_file])
                      			c = r.content.decode('utf-8')
                      			t = 'property="og:title" content="'
                      			i = c.find(t)
                      			if i >= 0:
                      				# <meta property="og:title" content="a.py"/>
                      				j = c.find('"/>',i)
                      				print(c[i+len(t):j])
                      			url_file = create_onedrive_directdownload(files[nam_file])
                      .
                      .
                      .
                      
                      1 Reply Last reply Reply Quote 0
                      • Tito
                        Tito last edited by

                        @cvp wow this is really awesome!!

                        Thanks so much, I will study your code and try to use it on my workflow.

                        Thanks again.

                        1 Reply Last reply Reply Quote 0
                        • ccc
                          ccc last edited by ccc

                                  for url in files.values():
                                      text = requests.get(url).text
                                      tag = 'property="og:title" content="'
                                      _, _, content = text.partition(tag)
                                      if content:
                                          content, _, _ = content.partition('"/>')
                                          print(content)
                                      url_file = create_onedrive_directdownload(url)
                          

                          ... or maybe ...
                          from bs4 import BeautifulSoup
                          soup = BeautifulSoup(requests.get(url).content, 'html.parser')
                          content = soup.find("content").text

                          cvp 3 Replies Last reply Reply Quote 0
                          • cvp
                            cvp @ccc last edited by cvp

                            @ccc I had tried with Eval_js on ui.WebView but there was a lot of "content" and other tries.
                            I'm sure there is a better analysis but my initial challenge was to get the links of the shared files.

                            1 Reply Last reply Reply Quote 0
                            • cvp
                              cvp @ccc last edited by

                              @ccc said:

                              for url in files.values():

                              I always forget this function. I'm sure that I become too old and that I'll have to find soon a new hobby 😢

                              Anyway, as usual, thanks for your advices. Even if I can't use them, other Python beginners will.

                              1 Reply Last reply Reply Quote 0
                              • ccc
                                ccc last edited by

                                Dude... I am 61 years old... No excuses... Keep pushing ;-)

                                cvp 1 Reply Last reply Reply Quote 0
                                • cvp
                                  cvp @ccc last edited by

                                  @ccc too late I just bought one

                                  1 Reply Last reply Reply Quote 1
                                  • cvp
                                    cvp @ccc last edited by

                                    @ccc said:

                                    for url in files.values():

                                    But later in the loop, I also use the files key (nam_file), thus...

                                    mikael 1 Reply Last reply Reply Quote 0
                                    • mikael
                                      mikael @cvp last edited by

                                      @cvp

                                      for filename, url in files.items():
                                      

                                      😁😉

                                      1 Reply Last reply Reply Quote 2
                                      • Tito
                                        Tito last edited by

                                        Hi, I’ve been trying but I think this is too complex for my skills.

                                        You’ve been saying you were old guys, I’m felling useless at my almos brand new forties.

                                        I don’t really understand how the function resolves the file and in my procedure I have to deal with an FTP server instead of an SFTP, so I don’t know where to touch the code and switching functions.

                                        Many thanks for your help, and sorry for bothering, I’ll keep trying.

                                        1 Reply Last reply Reply Quote 0
                                        • ccc
                                          ccc last edited by ccc

                                          What error messages are you seeing?

                                          https://docs.python.org/3/library/ftplib.html

                                          Tito 1 Reply Last reply Reply Quote 0
                                          • Tito
                                            Tito @ccc last edited by

                                            @ccc thanks for answer and the link

                                            I’m starting from here:

                                            # coding: utf-8
                                            import appex
                                            import console
                                            import os
                                            import ui
                                            from ftplib import FTP
                                            def main():     
                                            # Sharing: receive file 
                                                fil = appex.get_file_path() 
                                                if fil == None:
                                                    print('no file passed')
                                                    return
                                                
                                                server = 'address'
                                                user = 'account'
                                                pwd = 'pass'
                                                server_file = os.path.basename(fil)
                                                
                                                try:
                                                    ftp = FTP(server) #connect
                                                    ftp.encoding = 'utf-8'
                                                    ftp.login(user,pwd)
                                                    ipad_file = open(fil,'rb')
                                                    ftp.storbinary('STOR '+server_file,ipad_file,blocksize=8192)
                                                    ipad_file.close()
                                                    ftp.close() 
                                                except Exception as e:
                                                    print(str(e))
                                            appex.finish()
                                                
                                            if __name__ == '__main__':
                                                main()
                                            

                                            With this code I take a file on OneDrive and upload it to a FTP server, but the code is made for taking files from iOS menu (I think that’s the appex part for the code structure).

                                            Now here it comes the code that @cvp kindly searched and found it points to a web link route, it points to a file through an extracted link (is really awesome, black magic for me...).

                                            As you can see, I’m not a coder, I tried to learn python, bought a book (Learn Python the Hard Way) but got jammed soon. And I have this problem with Pythonista when I search for info about python, the code is tailored for a computer environment, and making it work on Pythonista changes the game a lot.

                                            Sorry I lost focus on this and I’m telling you my sorrows.

                                            I tried to do it in parts first try to understand the code and make it run alone.

                                            def create_onedrive_directdownload (onedrive_link):
                                                data_bytes64 = base64.b64encode(bytes(onedrive_link, 'utf-8'))
                                                data_bytes64_String = data_bytes64.decode('utf-8').replace('/','_').replace('+','-').rstrip("=")
                                                resultUrl = f"https://api.onedrive.com/v1.0/shares/u!{data_bytes64_String}/root/content"
                                                return resultUrl 
                                            

                                            I tried to put the OneDrive link on (onedrive_link) I thought it was the first position working as a shortcut but I got an “invalid syntax” error... I’ve noticed that my OneDrive links are not the same as the ones from the article (1drv vs my works personalised direction https:://xxxxxx-my.share point.com/:x:/g/personal/... maybe could be there the issue.

                                            My next step would be to get the file and upload to the FTP address and after that try to make it work with two files and upload the together.

                                            Thanks for your valuable help, I’m a mess with this and I’m trying, for me was a big win to understand the previous code for uploading files from iOS with the script. In the beginning I had to open an ftp app and navigate to the route every time I wanted to upload a file with this script I only have to check that everything worked smoothly, my goal was doing both things on a tap.

                                            I’m asking myself, if I put a Pythonista script pointing to the files I have to upload in the OneDrive folder, would it found them? I suppose this shouldn’t need any route, only file names, am I right?

                                            cvp 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Powered by NodeBB Forums | Contributors