I'm using SSIS 2008 to insert data in CRM Dynamics 2013.
We have two servers, the first is for the CRM installation and the seconde SQLServer database.
I wrote a script in SSIS to push data to the CRM, but every time I get a timeout error even if I set it to a higher number.
Anyone have an idea how to solve this problem? Thanks.
Try replicating your script component in to 10 parts. This way, you will have several different instances of service inserting/updating data parallel.
Related
We have been using the Arrango DB for a while. As per the recent requirement, we are developing Dashboards Power BI. As per the instructions in the Power Bi - Arrango DB interaction Guide we have created connectors and are able to access the data. But after certain days(roughly 30 days of usage) when we are receiving the error "(503): Service Unavailable" when trying to connect to the Connector. We tried creating a new connector but after a few days, we have encountered a similar issue.
We are unable to understand the root cause for the issue. For working with dashboards we can create new connectors but it is quite not easy to update the data source in all the dashboards. We are not sure if the issue linked with Powe Bi releases
FYI:: we also have tried re-creating the connector with the same configuration of an issue connector. But still, we get 503 error
Tools:
Arrango DB 3.8.0 Community edition
Power BI Desktop Version: 2.98.1025.0 64-bit (October 2021)
Thanks in advance and please let me know if you need any information from our end.
Recently we are able to find solve this problem. The root cause of the issue is the change in the name of the collections, the code of the connector checks the existence of all the collections defined in the list and if the collection is missing then we get the 503 Service unavailable. So even a small change in the collection name spelling (even the case) might trigger this error.
I am trying to import a view (having 700M rows)from Azure Synapse in Microsoft Power BI, while it works intially and imports around 70M rows successfully but the connection gets dropped after that and following error appears.
Can Someone help me here?
I presume this is a dedicated SQL pool in Synapse.
If that's the case, I would suggest checking the following, in this order:
Intermittent connection issues if the query is taking some time to complete. You can test that with several tools, including command prompt.
Check service availability in the Azure Synapse resource, under the left menu "Diagnose and solve problems."
Optimise the query
Check your Azure Synapse firewall settings
Another test you can do is to temporarily change the view to return less records, to isolate the problem.
Is it possible in C++ Visual studio that I can connect to SAP Database, write data to it ?
For example, I'm doing a facial recognition project and it's already done, but the remaining part is to connect SAP and write the Face ID of the user to the HR database plus the time stamp.
Ahmed, first you need to determine what the database your SAP system is running on, doesn't sound like you know so get that information first so you can get the right driver. Then the answer to your question is, yes. Create a connection using your driver first to connect to the server and database you are trying to update, you'll need to get the server name, database name and database credentials for your DBA, then in Visual Studio go to View > Server Explorer to add access to your new connection and then write your SQL to update insert you records.
The second part, yes if you write to the database tables properly it will show up in SAP.
Is there any way to call a web service in a ssis package in order to insert some data into a table within SQL Server? How? any sample or guidance please?
I assume by your question, you are referring to using a web service as a destination for a data flow? I inherited a series of packages that integrate with our MS CRM site. As designed, these packages are a horrible fit for the SSIS paradigm but that's my burden to bear...
These packages generally fit the form of Source (OLE DB or Flat File) fed to a Script Task (destination). I don't know that providing all the code of a particular task would be enlightening. It's simply invokes the web service for each row sent into it. RBAR is not what SSIS or set based languages are made for but you can certainly do it.
The Script transformation will have a web reference (ours is named CrmSdk) to the service.
Declare an instance of the service as a member of ScriptMain.
Instantiate that service in your script, passing credentials as needed. Most likely in your PreExecute method
Make calls to the web service in your Input0_ProcessInputRow method using the Row.Column1 notation. Do be aware of nulls and how the web service handles them. Our code uses service.CompanyName = Row.CompanyName_IsNull ? string.Empty : Row.CompanyName;
If your intention is to use a web service at the Control Flow level, be aware that the default Task has a hard coded 5 minute timeout. Not sure if that's still the case, but in the 2005 package I was dealing with, we had to use a straight Script Task to communicate with our webservice (it was cleansing millions of rows of address data in batch fashion) to bypass the timeout issue. Reference to timeout property
Could someone please help me with whether it's possible to use a full blown SQL Server as Local Database Cache instead of CE?
The reason being CE has 4GB limit. CE is not an option for us as our database records will grow significantly within few months.
Any alternative solution will be much appreciated.
if you're referring to the Local Database Cache project item in Visual Studio, the answer is no. Only Sql Compact (SqlCeClientSyncProvider) is supported by that wizard. You can however handcode your own provider and the sync code without using the wizard.
or you can just use the SqlSyncProvider (can be used against Sql Express, Sql Server, Sql Azure).
see: Synchronizing SQL Server and SQL Express