Is it possible to load data from "CSV file in Sharepoint online" to "Sql Server table" using SSIS without downloading the file to local folders. (I need to deploy the package to Integration Service Catalogs in Sql Server)
Could anyone help me on solving this issue.
You can use the Odata Source with a OData Connection to Access Sharepoint Lists with files. There are a couple tutorials:
https://www.sqlshack.com/how-to-configure-odata-ssis-connection-for-sharepoint-online/
https://www.timmitchell.net/post/2021/01/08/connecting-to-sharepoint-lists-with-ssis/
Related
I've developed a SSIS ETL job/workflow to scan for new files in a folder and load the data from the new file into a SQL Server table. This job basically implements searches for a file with a predefined file name pattern in a predefined folder location. I followed all the steps mentioned here. However, the tricky part is that my company uses Box.com for file storage and the particular folder where the SSIS job has to search for new files is on Box.com. When I use my local Box-Sync Path and run the job on my local machine, I am able to execute the entire package successfully and load the new data into the required table. However, when I deploy this job in the SSIS Catalog and try to run it from the Server, the job fails as the SQL Server is unable to resolve the local Box-Sync Path that's specific to my machine.
Could anyone suggest which path I should be using to get rid of this error and schedule the job successfully on the Server.
TIA.
You will need to create a Box-Sync path on a server that your SSIS agent has access to and use either a UNC path to that Sync folder, or a path that is local to your SSIS Server.
i tried to copy the file using copy/xcopy from batch file, but it is not working.
then i downloaded ssis integration tool kit from (http://www.kingswaysoft.com/products/ssis-integration-toolkit-for-microsoft-sharepoint/download ) and tried to create a sharepoint connection manger to send the file using file system task, but getting error as unknown namespace type for user in sharepoint connection manager while creating connection manager.
is there any other way to send the files to sharepoint.
Thank you for downloading our software.
It looks like you were not able to build the connection with SharePoint. Can you post the full error message so that we can better assist you?
Once you have created the SharePoint connection manager, it would be fairly easy to upload files to SharePoint using the Premium File Transfer Task which comes with our SharePoint Toolkit.
You can also reach out to us through our official support channel if you have any further questions.
Best regards,
KingswaySoft Support
I have a set of reports on a SSRS 2012 server and they work fine. We are moving to a new server, so I changed the server in the report property and redeployed. The reports are on the new server, but none of the shared datasets and data sources work anymore. I get this error:
Cannot create a connection to data source ' Data source for shared dataset'. (rsErrorOpeningConnection)"
All the datasets and data sources use predefined credentials. I look at the reports in Visual Studio and I can connect just fine. Can anyone tell me why deploying to a new server breaks everything?
If your data sources contain stored credentials, you need to backup the encryption key from the original server and restore it in the new one. Otherwise those shared data sources won't work. If this is the case and you know the credentials, you can edit manually all those shared data sources.
Credentials stored in embedded data sources won't work as well if you don't restore the encryption keys.
You can query the SSRS database in several ways to discover all those Shared Data Sources and embedded ones, you can find them in this site. One example could be
Listing all Data Sources and their Dependencies (reports, items, etc) in SQL Server 2008 R2
Hope this helps
I'm fairly new to SSIS and am having trouble figuring out something that seems like it should be straight forward:
On server A, I have 10 files in "C:\SourceFiles\Patients" (these files are PDFs). I know the names of these 10 files and they won't change. Also, there is a server B which is the DB server and is where the SSIS package will be located. My goal is to loop through a DB table containing patients, add some patient data to the 10 source files (renaming the file) and then save this new file to server A.
I have most of this running already. Currently, all of this is happening in a script task using ADO.NET for the DB access (I'm already accessing the DB table on server B) and I'm accessing the source files on my local C drive.
I am having trouble figuring out how to specify server A in the Package Configuration for the source files. I have a file connection which specifies an existing folder (C:\SourceFiles\Patients), but it only specifies the location of the folder NOT the server. How to I specify server A for this file connection? Or, how do I use this file connection with a server A connection? I'm having real difficulty grasping this for some reason!!
The technologies I'm using are:
Visual Studio 2008,
C# in the SSIS script task,
ADO.NET in the SSIS script task and
SQL Server Management Studio 2008 (SSIS package will be imported here).
Thanks for pointing me in the right direction!
I see some issues with what you are trying to do.
PDF is an image format (an image of a document) and as such is not easily manipulated by SSIS. Generally if you are acting on a file from within SSIS, it would be a flat file of some sort, like a CSV or some other text format.
Using a script task to do all of your work within SSIS is failing to use the power of SSIS properly. If all you have in your SSIS project is a script task, you should just be using C# or VB.net directly and not involving SSIS in your project at all.
That all being said, you should access your files on server A using UNC (Universal Naming Convention) paths. You will need to pay close attention to your permissions within SSIS to make this work. When an SSIS job runs, it runs under a specific user, usually the SQL Server Agent user, and that user will need permissions to access the folder on server A remotely. When all of these permissions are set correctly, you can use something akin to \\ServerA\ShareName\Patients\ as the pointer to your directory with pdf's in it.
How do I set up a scheduled job in SQL Server 2008 that connects to a ftp server and transfers a file either to a local drive or even better into a table.
I think I can use SSIS (at least that I read) but can't find a tutorial or like.
If I can just get the file to my local drive then I good but of course the even better solution is a file transfer directly into a table :)
Definetely possible with SSIS.
Use Business Intelligence Studio to design the SSIS package, then you can schedule this package as SQL Agent job.
SSIS can't transfer it directly to the table, but it can download it to temporary file (use FTP task), then load it to table (depends on file format, most likely you'll need to use Data Flow task), and delete file (File System task).