Failed to CREATE_FILE in hdfs - hdfs

I have a java program that try to write a file into hdfs, but i get this error message:
Failed to CREATE_FILE /data/xxx because DFSClient_attempt_1552693040212_69961_m_000000_0_1265362509_1 is already the current lease holder.

Related

mlUnitTest throws a java.nio.file.NoSuchFileException at the end of the tests

I try to use mlunitTest with ml-gradle 3.17.1 and Marklogic marklogic-unit-test-client:1.0.0
All the tests are OK, I test with my test user on the UI and with ml-gradle.
But when ml-gradle wants to access the results in a directory [build\test-results\marklogic-unit-test\TEST-{test-name}], java throws an error because the file isn't there.
Just before there is a comment who precises that it clears the directory.
Does anyone use the mlunitTest without this problem?
it's the same if i give the name of the result directory with the parameter : -PunitTestResultsPath=testML
Here are the traces of this part of execution :
Done running all suites; time: 82ms
4 tests completed, 0 failed
Deleted existing results directory: build\test-results\marklogic-unit-test
Releasing connection
:mlUnitTest (Thread[Execution worker for ':',5,main]) completed. Took 0.093 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':mlUnitTest'.
> java.nio.file.NoSuchFileException: build\test-results\marklogic-unit-test\TEST-historicId.xml
Try release 4.3.0 - it includes the following fix - https://github.com/marklogic-community/ml-gradle/issues/599

Can't Launch Unreal Engine 4 in Arch Linux

I am having an annoying problem while launching unreal-engine. I installed it from the AUR, the game is installed in directory /opt/unreal-engine. Here is the log messages. I am still a beginner on both linux and unreal-engine, so guide me with easy to follow steps. Thanks.
LogUnixPlatformFile: Warning: create dir('/opt/unreal-engine/Engine/Saved/Config/Linux/Manifest.ini') failed: errno=13 (Permission denied)
LogUnixPlatformFile: Warning: create dir('/opt/unreal-engine/Engine/Saved/Config/Linux/Manifest.ini') failed: errno=13 (Permission denied)
LogUnixPlatformFile: Warning: create dir('/opt/unreal-engine/Engine/Saved/Config/CrashReportClient/UE4CC-Linux-F9CC0BA4D1E046998DB4DD29DC904FC3/CrashReportClient.ini') failed: errno=13 (Permission denied)
LogUnixPlatformFile: Warning: create dir('/opt/unreal-engine/Engine/Saved/Config/CrashReportClient/UE4CC-Linux-F9CC0BA4D1E046998DB4DD29DC904FC3/CrashReportClient.ini') failed: errno=13 (Permission denied)
[2020.02.05-06.48.13:587][ 0]LogUnixPlatformFile: Warning: open('/opt/unreal-engine/Engine/DerivedDataCache/8729777EB19D4DDAA2910A8040E24FC5.tmp', Flags=0x00080041) failed: errno=13 (Permission denied)
[2020.02.05-06.48.13:587][ 0]LogUnixPlatformFile: Warning: open('/opt/unreal-engine/Engine/DerivedDataCache/8729777EB19D4DDAA2910A8040E24FC5.tmp', Flags=0x00080041) failed: errno=13 (Permission denied)
[2020.02.05-06.48.13:587][ 0]LogDerivedDataCache: Warning: Fail to write to ../../../Engine/DerivedDataCache, derived data cache to this directory will be read only. WriteError: 0 (errno=2 (No such file or directory)) ReadError: 0 (errno=2 (No such file or directory))
[2020.02.05-06.48.13:587][ 0]LogDerivedDataCache: Warning: Local data cache path (../../../Engine/DerivedDataCache) was not usable, will not use it.
[2020.02.05-06.48.13:587][ 0]LogDerivedDataCache: Unable to find inner node Local for hierarchical cache Hierarchy.
[2020.02.05-06.48.13:587][ 0]LogDerivedDataCache: Shared data cache path not found in *engine.ini, will not use an Shared cache.
[2020.02.05-06.48.13:587][ 0]LogDerivedDataCache: Unable to find inner node Shared for hierarchical cache Hierarchy.
[2020.02.05-06.48.13:612][ 0]LogMaterial: Verifying Global Shaders for SF_VULKAN_SM5
Fatal error: [File:/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Engine/Private/ShaderCompiler/ShaderCompiler.cpp] [Line: 1253]
Could not create the shader compiler transfer file '/opt/unreal-engine/Engine/Intermediate/Shaders/tmp/DD11AF6A45C44C8586192EE55DBE07C0/0A2ADC10248884539A8A1054157AD3D00'.
Signal 11 caught.
Malloc Size=65538 LargeMemoryPoolOffset=65554
CommonUnixCrashHandler: Signal=11
Malloc Size=65535 LargeMemoryPoolOffset=131119
Malloc Size=439632 LargeMemoryPoolOffset=570768
Malloc Size=330840 LargeMemoryPoolOffset=901624
[2020.02.05-06.48.37:669][ 0]LogCore: === Critical error: ===
Unhandled Exception: SIGSEGV: invalid attempt to write memory at address 0x0000000000000003
[2020.02.05-06.48.37:669][ 0]LogCore: Fatal error: [File:/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Engine/Private/ShaderCompiler/ShaderCompiler.cpp] [Line: 1253]
Could not create the shader compiler transfer file '/opt/unreal-engine/Engine/Intermediate/Shaders/tmp/DD11AF6A45C44C8586192EE55DBE07C0/0A2ADC10248884539A8A1054157AD3D00'.
0x00007f76dd8d93f0 libUE4Editor-Engine.so!FShaderCompileThreadRunnable::CompilingLoop() [/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Engine/Private/ShaderCompiler/ShaderCompiler.cpp:1513]
0x00007f76dd8d45a9 libUE4Editor-Engine.so!FShaderCompileThreadRunnableBase::Run() [/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Engine/Private/ShaderCompiler/ShaderCompiler.cpp:1078]
0x00007f76e0202167 libUE4Editor-Core.so!FRunnableThreadPThread::Run() [/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Core/Private/HAL/PThreadRunnableThread.cpp:25]
0x00007f76e01c9a00 libUE4Editor-Core.so!FRunnableThreadPThread::_ThreadProc(void*) [/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Core/Private/HAL/PThreadRunnableThread.h:177]
0x00007f76e0cc54cf libpthread.so.0!UnknownFunction(0x94ce)
0x00007f76d7a792d3 libc.so.6!clone(+0x42)
0x00007f76e0197af6 libUE4Editor-Core.so!FGenericPlatformMisc::RaiseException(unsigned int) [/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Core/Private/GenericPlatform/GenericPlatformMisc.cpp:477]
0x00007f76e03abd97 libUE4Editor-Core.so!FOutputDevice::LogfImpl(char16_t const*, ...) [/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Core/Private/Misc/OutputDevice.cpp:71]
0x00007f76dd8d5b15 libUE4Editor-Engine.so!FShaderCompileThreadRunnable::WriteNewTasks() [/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Engine/Private/ShaderCompiler/ShaderCompiler.cpp:1253]
0x00007f76dd8d93f0 libUE4Editor-Engine.so!FShaderCompileThreadRunnable::CompilingLoop() [/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Engine/Private/ShaderCompiler/ShaderCompiler.cpp:1513]
0x00007f76dd8d45a9 libUE4Editor-Engine.so!FShaderCompileThreadRunnableBase::Run() [/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Engine/Private/ShaderCompiler/ShaderCompiler.cpp:1078]
0x00007f76e0202167 libUE4Editor-Core.so!FRunnableThreadPThread::Run() [/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Core/Private/HAL/PThreadRunnableThread.cpp:25]
0x00007f76e01c9a00 libUE4Editor-Core.so!FRunnableThreadPThread::_ThreadProc(void*) [/home/utkarsha/Applications/unreal-engine/src/unreal-engine/Engine/Source/Runtime/Core/Private/HAL/PThreadRunnableThread.h:177]
0x00007f76e0cc54cf libpthread.so.0!UnknownFunction(0x94ce)
0x00007f76d7a792d3 libc.so.6!clone(+0x42)
[2020.02.05-06.48.37:669][ 0]LogExit: Executing StaticShutdownAfterError
Engine crash handling finished; re-raising signal 11 for the default handler. Good bye.
fish: “./UE4Editor” terminated by signal SIGSEGV (Address boundary error)
#Utkarsha Khanal. Waiting simply fixed it for me, It took about 10-20mins on "verifying Global Shaders for SF_VULKAN_SM5" and then it booted up fine and compiled the shaders. Give that a try.
Same problem here. solved by changing folder permission. sync unreal want to not run as sudo, you have to make a change on folder permission first.

Cannot init Package Manage Console in Visual Studio 2017

I am using Visual Studio 2017 Enterprise on Windows 10.
And I have got these errors when I tried to use PM console.
The following error occurred while loading the extended type data file:
Microsoft.PowerShell.Core, C:\Windows\SysWOW64\WindowsPowerShell\v1.0\typesv3.ps1xml: The file was skipped because of the following validation exception: File C:\Windows\SysWOW64\WindowsPowerShell\v1.0\typesv3.ps1xml cannot be loaded because running scripts is disabled on this system. For more information, see about_Execution_Policies at http://go.microsoft.com/fwlink/?LinkID=135170..
Errors occurred while loading the format data file: Microsoft.PowerShell.Diagnostics, , C:\Windows\SysWOW64\WindowsPowerShell\v1.0\Event.Format.ps1xml: The file was skipped because of the following validation exception: File C:\Windows\SysWOW64\WindowsPowerShell\v1.0\Event.Format.ps1xml cannot be loaded because its operation is blocked by software restriction policies, such as those created by using Group Policy..
Errors occurred while loading the format data file: Microsoft.PowerShell.Core, , C:\Windows\SysWOW64\WindowsPowerShell\v1.0\Help.format.ps1xml: The file was skipped because of the following validation exception: File C:\Windows\SysWOW64\WindowsPowerShell\v1.0\Help.format.ps1xml cannot be loaded because its operation is blocked by software restriction policies, such as those created by using Group Policy..
Errors occurred while loading the format data file: Microsoft.WSMan.Management, , C:\Windows\SysWOW64\WindowsPowerShell\v1.0\WSMan.format.ps1xml: The file was skipped because of the following validation exception: File C:\Windows\SysWOW64\WindowsPowerShell\v1.0\WSMan.format.ps1xml cannot be loaded because its operation is blocked by software restriction policies, such as those created by using Group Policy..
Errors occurred while loading the format data file:
Microsoft.PowerShell.Diagnostics, , C:\Windows\SysWOW64\WindowsPowerShell\v1.0\Event.Format.ps1xml: The file was skipped because of the following validation exception: File C:\Windows\SysWOW64\WindowsPowerShell\v1.0\Event.Format.ps1xml cannot be loaded because its operation is blocked by software restriction policies, such as those created by using Group Policy..
Microsoft.PowerShell.Core, , C:\Windows\SysWOW64\WindowsPowerShell\v1.0\Help.format.ps1xml: The file was skipped because of the following validation exception: File C:\Windows\SysWOW64\WindowsPowerShell\v1.0\Help.format.ps1xml cannot be loaded because its operation is blocked by software restriction policies, such as those created by using Group Policy..
Microsoft.WSMan.Management, , C:\Windows\SysWOW64\WindowsPowerShell\v1.0\WSMan.format.ps1xml: The file was skipped because of the following validation exception: File C:\Windows\SysWOW64\WindowsPowerShell\v1.0\WSMan.format.ps1xml cannot be loaded because its operation is blocked by software restriction policies, such as those created by using Group Policy..
I removed %AppData%/Local/Microsoft/Visual Studio folder.
And reboot laptop, reopened Visual Studio but the same errors occurred.
Can you please fix this?

Pass command's stderr from a build task into Azure DevOps

I have a VSTS (Azure DevOps) build which contains a PowerShell or a Command line task. This task is running some program: program.exe. When program.exe returns a non-zero exit code, the build is failed as expected. program.exe also prints a detailed error message to the stderr stream in case of an error.
The problem is that the content of the stderr stream is not passed to the build. The task is always returning the following error message which is also displayed as a build failure message on the build summary tab:
Process completed with exit code 1.
Which is useless. The user has to look for a failed task, open its output and search for an error message there. That's not very convenient.
How to easily pass the content of stderr to the build?
Do I have to manually capture stderr and then send it to the build using PowerShell or is there a setting to change the build behaviour to work as I expect?
I just added "2>&1 | Write-Host" to the command so that the stderr stream will be routed to the Write-Host stream. Reference this thread: VSTS build fails with "Process completed with exit code 0 and had 3 error(s) written to the error stream." even though I set my PowerShell script to ignore errors
You can also try uncheck the Fail on Standard Error in your PowerShell script configuration and write the lastexitcode to pass the task:
Fail on Standard Error
If this is true, this task will fail if any errors are written to the
error pipeline, or if any data is written to the Standard Error
stream. Otherwise the task will rely solely on $LASTEXITCODE and the
exit code to determine failure.
Then you can output the error or warning by using PowerShell or VSTS task commands.
Write-Warning “warning”
Write-Error “error”
Write-Host " ##vso[task.logissue type=warning;]this is the waring"
Write-Host " ##vso[task.logissue type=error;sourcepath=consoleapp/main.cs;linenumber=1;columnnumber=1;code=100;]this is an error "
More information about the VSTS task command, you can refer to: Logging Commands

failed to run boost mpi

After successfully build my c++ program using boost mpi library in a super computer resource. I failed to run my program:
login2.stampede(23)$ ./polytope
LiMIC: (limic_open) file open fail
[unset]: aborting job:
Fatal error in MPI_Init:
Other MPI error, error stack:
MPIR_Init_thread(436)....:
MPID_Init(371)...........: channel initialization failed
MPIDI_CH3_Init(335)......:
MPIDI_CH3I_SMP_Init(1723): LiMIC2 device does not exist: No such file or directory
Does anyone has any hint on what is possibly happening? Thank you.