Add public SentencePieceTokenizer factory methods for Unigram from vocab list and tokenizer.json#7625
Build #20260715.1 had test failures
Details
- Failed: 151 (0.35%)
- Passed: 38,715 (89.50%)
- Other: 4,390 (10.15%)
- Total: 43,256
Annotations
Check failure on line 31 in Build log
azure-pipelines / MachineLearning-CI
Build log #L31
Bash exited with code '1'.
Check failure on line 61 in Build log
azure-pipelines / MachineLearning-CI
Build log #L61
Bash exited with code '1'.
Check failure on line 31 in Build log
azure-pipelines / MachineLearning-CI
Build log #L31
Bash exited with code '1'.
Check failure on line 31 in Build log
azure-pipelines / MachineLearning-CI
Build log #L31
Bash exited with code '1'.
Check failure on line 1 in Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test
azure-pipelines / MachineLearning-CI
Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test
System.IO.InvalidDataException : End of Central Directory record could not be found.
Raw output
at System.IO.Compression.ZipArchive.ReadEndOfCentralDirectory()
at System.IO.Compression.ZipArchive..ctor(Stream stream, ZipArchiveMode mode, Boolean leaveOpen, Encoding entryNameEncoding)
at System.IO.Compression.ZipFile.Open(String archiveFileName, ZipArchiveMode mode, Encoding entryNameEncoding)
at System.IO.Compression.ZipFile.ExtractToDirectory(String sourceArchiveFileName, String destinationDirectoryName, Encoding entryNameEncoding, Boolean overwriteFiles)
at System.IO.Compression.ZipFile.ExtractToDirectory(String sourceArchiveFileName, String destinationDirectoryName)
at Microsoft.ML.AutoML.Test.DatasetUtil.UnZip(String gzArchiveName, String destFolder) in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 231
at Microsoft.ML.AutoML.Test.DatasetUtil.DownloadImageSet(String imagesDownloadFolder) in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 191
at Microsoft.ML.AutoML.Test.DatasetUtil.GetFlowersDataset() in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 136
at Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test() in /__w/1/s/test/Microsoft.ML.AutoML.Tests/AutoFeaturizerTests.cs:line 107
at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
Check failure on line 1 in Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test
azure-pipelines / MachineLearning-CI
Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test
System.IO.InvalidDataException : End of Central Directory record could not be found.
Raw output
at System.IO.Compression.ZipArchive.ReadEndOfCentralDirectory()
at System.IO.Compression.ZipArchive..ctor(Stream stream, ZipArchiveMode mode, Boolean leaveOpen, Encoding entryNameEncoding)
at System.IO.Compression.ZipFile.Open(String archiveFileName, ZipArchiveMode mode, Encoding entryNameEncoding)
at System.IO.Compression.ZipFile.ExtractToDirectory(String sourceArchiveFileName, String destinationDirectoryName, Encoding entryNameEncoding, Boolean overwriteFiles)
at Microsoft.ML.AutoML.Test.DatasetUtil.UnZip(String gzArchiveName, String destFolder) in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 231
at Microsoft.ML.AutoML.Test.DatasetUtil.DownloadImageSet(String imagesDownloadFolder) in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 191
at Microsoft.ML.AutoML.Test.DatasetUtil.GetFlowersDataset() in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 136
at Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test() in /__w/1/s/test/Microsoft.ML.AutoML.Tests/AutoFeaturizerTests.cs:line 107
at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
Check failure on line 1 in Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test
azure-pipelines / MachineLearning-CI
Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test
System.IO.InvalidDataException : End of Central Directory record could not be found.
Raw output
at System.IO.Compression.ZipArchive.ReadEndOfCentralDirectory()
at System.IO.Compression.ZipArchive..ctor(Stream stream, ZipArchiveMode mode, Boolean leaveOpen, Encoding entryNameEncoding)
at System.IO.Compression.ZipFile.Open(String archiveFileName, ZipArchiveMode mode, Encoding entryNameEncoding)
at System.IO.Compression.ZipFile.ExtractToDirectory(String sourceArchiveFileName, String destinationDirectoryName, Encoding entryNameEncoding, Boolean overwriteFiles)
at Microsoft.ML.AutoML.Test.DatasetUtil.UnZip(String gzArchiveName, String destFolder) in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 231
at Microsoft.ML.AutoML.Test.DatasetUtil.DownloadImageSet(String imagesDownloadFolder) in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 191
at Microsoft.ML.AutoML.Test.DatasetUtil.GetFlowersDataset() in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 136
at Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test() in /__w/1/s/test/Microsoft.ML.AutoML.Tests/AutoFeaturizerTests.cs:line 107
at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
Check failure on line 1 in Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test
azure-pipelines / MachineLearning-CI
Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test
System.IO.InvalidDataException : End of Central Directory record could not be found.
Raw output
at System.IO.Compression.ZipArchive.ReadEndOfCentralDirectory()
at System.IO.Compression.ZipArchive..ctor(Stream stream, ZipArchiveMode mode, Boolean leaveOpen, Encoding entryNameEncoding)
at System.IO.Compression.ZipFile.Open(String archiveFileName, ZipArchiveMode mode, Encoding entryNameEncoding)
at System.IO.Compression.ZipFile.ExtractToDirectory(String sourceArchiveFileName, String destinationDirectoryName, Encoding entryNameEncoding, Boolean overwriteFiles)
at Microsoft.ML.AutoML.Test.DatasetUtil.UnZip(String gzArchiveName, String destFolder) in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 231
at Microsoft.ML.AutoML.Test.DatasetUtil.DownloadImageSet(String imagesDownloadFolder) in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 191
at Microsoft.ML.AutoML.Test.DatasetUtil.GetFlowersDataset() in /__w/1/s/test/Microsoft.ML.AutoML.Tests/DatasetUtil.cs:line 136
at Microsoft.ML.AutoML.Test.AutoFeaturizerTests.AutoFeaturizer_image_test() in /__w/1/s/test/Microsoft.ML.AutoML.Tests/AutoFeaturizerTests.cs:line 107
at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)