Binary Cross Entropy

Does 0.69 sounds familiar. Definitely we dont like it.

#AI

If you ask an #ai scientist if it would be possible to generate an AI that understands and extends research papers, he will appreciate the difficulty of the task since it is his domain. However, there are some who could claim end-to-end workflows are possible in some other areas where they do not have enough knowledge. We often oversimplify the domain with over complexified neural architectures. In most cases, we don't need full automation but better integration, faster and more transparent response, and more iteration in the real world to eliminate unnecessary tasks. It is not about replacing humans, it is allowing people to do better. Here is my joke to illustrate this.

Cudnn

I was getting error "Could not load dynamic library 'libcudnn.so.8'; dlerror:" I realized that it was arm version. I replaced it so it resolved. The speed is 6 times faster

Publication Bias

Publication Bias

A generated article about machine learning from machine learning

We expect many publish articles for the people who applied machine learning to write them. By putting them into a form in the context of human nature, editors of writings in machine learning should be able to see that they are part of a larger strategy for building a better understanding of human behavior. Machine learning makes a positive contribution to human social interactions. In addition to creating a more social environment for ourselves, it may make our life easier for our children and grandchildren to live vicariously through our creativity, good health, and successful learning opportunities. Machine learning is a big win for human learning today. It shows how smart machines make smarter choices and can be used to improve society. It is also a success for us as learners because we have free resources and opportunities to learn more. For more information on what Machine Learning does for our personal and professional lives, I highly recommend checking out my book "Makers of Social Change." This article, edited for length and clarity by machine learning, demonstrates machine learning at a young age. A young kid may not understand all the techniques given to them when designing their life, but I did learn from a teacher who taught me how to write, read and collaborate with his kids as he would go about his day. And those tools would help me continue my education and build a smarter, more complete, more successful life Maybe you know the story already. It's not just good advice — it's a pattern that repeats throughout history and the stories we tell ourselves. Ask any long-time entrepreneur the defining difference between a successful entrepreneur and a failed one, and almost everyone will tell you it's an ability to speak intelligently to others and listen to their stories.

Interactive Resume

halidziya.github.io

ML Rot

As software rots due to chances in dependency machine learning model rots due to change in data. HDR, higher resolutions, new encoding formats will have impact on existing methods.

Machine Learning Deployment

Machine learning deployment is mostly matrix multiplications and exp function around the results of matrix multiplications. It is especially interesting for me to have front end deployment where there is no need for connectivity and it allows further scalability. We have done this for Tajweedmate using tensorflow lite. Luckily it is working. tajweemate.com

Your personal universe is giantic, do not fight do science.

Bilimin degisik alanlarinda hayal kurmaktan kendimi alamiyorum, cam merceklerle kumu eritip tekrar mercek uretme, havadan carbonu cekip elmas yapma, pasificteki copleri recycle ederek yeni bir yapay kita olusturma gibi ucuk seyler aklima geliyor. Ama mumkun bunlar kucuk orneklerini yapan insanlar var

Tongue Twister

I was optimizing my optimizer, I realized my optimization was not optimum due to dependencies, then I have optimized the dependencies to optimize my optimization optimization process.

Self writing paper

Another definition, a paper that does not gives tables and figures but writes a program within itself like javascript to be able to generate those images automatically based on updated configuration settings and data included.

New computing area

hoe does it sound if I say decent architech for the people gained expertise in the area of decentralized computing instead of cloud

NodeJS breakpoint

setBreakpoint('main.mjs', 19)

Masum bir kahvalti

Icinde haslanmis kus embriyosu, yanina inek yavrusu icecegi, ezilmis soslanmis hayvan parcalari, bir miktar olu bitki kokleri ve zehirli ari ciktisi ile. Aslinda bizim koydugumuz isimler yumurta, sut, sucuk ... isin hakikatini gizliyoruz bunlarla.

NodeJS debugger

https://nodejs.org/api/debugger.html

Medeniyet

Caydas medeniyetler seviyesine ulastik

AM I AI ?

The first move of AM I AI released in amiai.art It is not a static image. It is a new form of interactive art. You can send your feedback to artgeneratingmachines@gmail.com https://amiai.art/

A new upcoming art form

Live Demo

Iframe pdf on landing page

Regularization

Regularization is symptomatic remedy for overfitting. But it does not solve the real problem. The real problem is we should not trust our loss function that much.

Click to listen

Run following command in js console if you want make web sites audible with a click document.getElementsByTagName("p")].map(p => p.addEventListener('click', e => speechSynthesis.speak(new SpeechSynthesisUtterance(e.srcElement.innerText)), true))

Web storage

One of the interesting capability of javascript is, it allows you to store data on client side. The only thing you need to do is storing your data in key value-string pairs. localStorage.setItem('key',JSON.stringify({"data":"object"})); The limitation however is the size is 5mb at most.

Time Zones

Our parents were arranging their schedule according to sunrise and sunset. They are still consistent in their habit. However, in our generation we are unable to sleep before 12pm for most of the time. Thus, we don't need to arrage the time according to sunset and sunrise. Instead whole world could be in single time zone say GMT +0. In this case we don't need to convert our time information while communicating. For example it would be 16 pm for everywhere whether it is sunset or sunrise. I will not change time zone if I travel. The time is the same time and actually absolute value does not matter.

A linear regression on Turkish Lira

I have used two pieces of linear regression breaking at the point of govermental change. Clearly there is a huge slope difference between two eras.

https://github.com/halidziya/turkish_lira

Soz Sanatlari

D50'nin 1'i kuyuya tas 60, 40 akilli kovaya 1000'mis, suyunda 100'mus anca 70.

A test example that most neural networks will fail

Set custom debugger for python

You can set PYTHONBREAKPOINT to set behaviour of breakpoint function. For example ipdb.set_trace. More Info

Computational Complexity

Even that the speed of a program is fast enough production it may not be fasy enough for experimentation. Because, you may need to many trials before settling the final configuration.

Blogger Phone App

Even that web interfaces are universal, still dedicated phone app from blogger makes it easy to post from phone.

x.99

We see x.99 prices everywhere. It is hacking human perception. Everybody does it does not mean that it is fair. I got an idea to develop a chrome extension that shows prices with x.99 by adding 1 cent on it.

C vs C++

Supposedly compatible to languages create problems in some cases. Recently I have faced cmath and stdlib do not work with each other. The compiler creates all sorts of strange errors.

Atan Sozler

Paslayan demir is tutmaz
Katlari diken, gulmeyi sever
Demleye demleye gel, olur
Balik yiyen bastan asagi kokar
Her et kusbasi yenmez
Yorgunsan yere ayagini uzat
Kupun darsa, sirke satma
Sakla zamani, kiymetli her ani

Git recover lost rebase

1. git reflog First identify the lost commit 2. git diff master commithash --name-only Check the differences in the files 3. git checkout commithash filepath Pick the one that you need

Get Json of Django Object

I found unnecessarily difficult to get json from django model object. Here is my simple solution to get that done.

def get_json_object(obj, fields): return {f:obj.__dict__[f] for f in fields}

New blog

I will post Machine Learning Deployments topic in my new blog. MLDeployments

No Real Style Transfer

Neural Networks are used to produce style transfer. But discrete structures are more difficult to generate. Here is my example. Does it resemble any picture to you?

Django + NGINX + USWGI

I was using "app" in the config, that was the reason why it did not work. Now converting to "application" it works. module=mysite.wsgi:application

Being Human

If you go to 20 generations before you are mixture of 2**20 ~ 1 million people.

TajweedMate v1 published

tajweedmate.com Android
Apple

CPPNs

Most of the time learning already known things is not a good idea in machine learning. Cppns are nice exceptions. Treat raster image as data and map coordinates to pixel values. The result is interesting, vector approximation of raster image. Better yet, multi layer function have potential to be more compact than pure vector lines.

Testing 3rd party api

Keeping the trials in a test suite for 3rd party api ensures consistency in later stages. a good suggedtion from book Clean Code

DRY Principle

I like the DRY (Do not repeat yourself) principle. In my words, do not copy-paste your code; use functions, modules, etc. to avoid that. This will reduce the point of maintenance. Wikipedia

Text to Speech in Browser

It would be a nice welcome, however I couldn't bypass user interaction requirement.

var msg = new SpeechSynthesisUtterance('Hi, Welcome'); window.speechSynthesis.speak(msg);

An update on resume

Resume

Do we really need Free Moving Windows ?

After using window managers many years I began to realize that most of the time we need grid manager. Moving windows freely serves only to create a layout which some of them would be visible. This could more effectively achieved by grid managers. https://www.w3schools.com/css/css_grid.asp

Lesson Land Online Lectures

lesson.land

tajweedmate.com

tajweedmate.com

Transform Your Negatives

Running Android on Kindle Paperwhite

I believe it is possible to run android on Kindle without rooting. The idea is using an emulator and a proxy service for Kindle's experimental browser.

An infinite loop

alist = [1] for a in alist: alist.append(a)

A little more freedom to kindle

I have recently stuck on being able to read android app based content on kindle. Kindle does not allow apps. Luckily app was allowing copy paste. I have used experimental browser and created a html page to display may clipboard. This allowed me to sync between my phone and kindle. I used "pre" tag for displaying text completely.

Yuzde Yuz

Yersiz derece yerlilik

Git Trick

https://stackoverflow.com/questions/9456550/how-to-find-the-n-largest-files-in-a-git-repository

Raster is memory, vector is intelligence

Our RCQA Workshop Paper

https://rcqa-ws.github.io/papers/paper8.pdf

Granite Countertops

https://unitedgranitepa.com/

Haber Cadiri

http://www.habercadiri.com/

Ignore White spaces in git

git diff --ignore-space-at-eol -b -w --ignore-blank-lines
https://coderwall.com/p/crj69a/from-a-useless-git-diff-to-a-useful-one

Python Counter

# collections.Counter lets you find the most common # elements in an iterable: >>> import collections >>> c = collections.Counter('helloworld') >>> c Counter({'l': 3, 'o': 2, 'e': 1, 'd': 1, 'h': 1, 'r': 1, 'w': 1}) >>> c.most_common(3) [('l', 3), ('o', 2), ('e', 1)] === https://realpython.com/

Python 3.7 debugging

Python 3.7 has internal function breakpoint(). It goes into pdb if it hits that function. https://www.python.org/dev/peps/pep-0553/

I just forgot to transpose

julia> x*x ERROR: MethodError: no method matching *(::Array{Int64,1}, ::Array{Int64,1}) Closest candidates are: *(::Any, ::Any, ::Any, ::Any...) at operators.jl:502 *(::LinearAlgebra.Adjoint{#s549,#s548} where #s548<:Union{DenseArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2}, ReinterpretArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, ReshapedArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, SubArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2,A,I,L} where L where I<:Tuple{Vararg{Union{Int64, AbstractRange{Int64}, AbstractCartesianIndex},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, ReshapedArray{T,N,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}where N where T, DenseArray}} where #s549, ::Union{DenseArray{S,1}, ReinterpretArray{S,1,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, ReshapedArray{S,1,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, SubArray{S,1,A,I,L} where L where I<:Tuple{Vararg{Union{Int64, AbstractRange{Int64}, AbstractCartesianIndex},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, ReshapedArray{T,N,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, DenseArray}}) where {T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64}, S} at C:\cygwin\home\Administrator\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.0\LinearAlgebra\src\matmul.jl:97 *(::LinearAlgebra.Adjoint{#s549,#s548} where #s548<:LinearAlgebra.AbstractTriangular where #s549, ::AbstractArray{T,1} where T) at C:\cygwin\home\Administrator\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.0\LinearAlgebra\src\triangular.jl:1805 ...Stacktrace: [1] top-level scope at none:0 julia> x*x'3×3 Array{Int64,2}: 1 2 3 2 4 6 3 6 9

3D multiplication with PyTorch https://pytorch.org/docs/stable/torch.html#torch.bmm

Complete Front End Deep Learning

Tensorflow publishes a front-end library that supports GPU training. https://js.tensorflow.org/

Purdue Online Writing Lab https://owl.english.purdue.edu/owl/

Metadata kept in Windows cache, refused to mount

I think this is related to hibernation. I have found the solution sudo ntfsfix /dev/sda(#)

Symmetric Dirichlet in d dimensions

function res=dirchrnd(alpha,d)
res = zeros(d,1);
for i=1:d
res(i)=gamrnd(alpha,1);
end
res=res/sum(res);
end

My new domain name

http://www.ideawarehouse.org

Short Shopping Cycle

One day project:

https://devpost.com/software/short-shopping-cycle?ref_content=contribution-prompt&ref_feature=engagement&ref_medium=email&utm_campaign=contribution-prompt&utm_content=contribution_reminder&utm_medium=email&utm_source=transactional#app-team

Juno Atom Julia v0.5

I received this error after updating Atom packages of Julia
"unknown package Juno required by Atom"

I attempt to solve using
Pkg.clone("https://github.com/JunoLab/Juno.jl.git")
Pkg.update()
using Atom

However, in next step Gallium gave an error.
I removed package Gallium and added again.

Then with existing installation of Atom, Julia works after precompilation finishes.

MATLAB Wrapper for Parallel Dirichlet Process Slice Sampler

https://www.mathworks.com/matlabcentral/fileexchange/59026-parallel-dirichlet-process-slice-sampler

Using Global Namespace functions

If you would like to use the global function while defining function with same name use this way :

Vector Vector::exp()
{
Vector& r = buffer.get();
for (int i = 0; i r.data[i] = ::exp(data[i]);
return buffer.next();
}

A julia implementation for Parallel Dirichlet Process Slice Sampler

https://github.com/halidziya/DPSliceSampler.jl

Nips Autosuggest for Overleaf

https://github.com/halidziya/NipsAutoSuggest

Peekaboo: Machine Learning Cheat Sheet (for scikit-learn)

Peekaboo: Machine Learning Cheat Sheet (for scikit-learn)

A useful roadmap maybe needs some updates

Configuring Matlab MEX for VS15

XML files located in matlabroot '\bin\win64\mexopts'
Compiler options also stored on those XML files
http://kaba.hilvi.org/homepage/blog/vs2015_in_matlab_2015/vs_2015_in_matlab_2015.htm

Hierarchical Latent Word Clustering

Our paper in NIPS BNP workshop.
https://sites.google.com/site/nipsbnp2015/accepted-papers
https://drive.google.com/file/d/0B1-Vx4o3v8xfVWZxd3pVeDFXeHc/view

Twitter Rate Limits

Twitter allows to capture 3200 tweets in the timeline.
A java program bypasses this limit using search system
https://github.com/Jefferson-Henrique/GetOldTweets

Bayesian Nonparametrics: The Next Generation

https://sites.google.com/site/nipsbnp2015/

Selecting Specific Elements in the matrix

Sometimes I would like to select elements in the Matlab matrix with their coordinate. However, if I used two arrays to get elements in Matlab it returns the rows and columns containing those elements. To get exact elements, I used following method where indx and indy is index coordinates:

A(sub2ind(size(A),indx,indy))

The Infinite Mixture of Infinite Gaussian Mixtures

http://papers.nips.cc/paper/5299-the-infinite-mixture-of-infinite-gaussian-mixtures

Matlab external programs in background

 system('start /b program.exe');

http://www.mathworks.com/matlabcentral/newsreader/view_thread/85377

Named rows and columns

R has built-in support for naming rows and columns for matrices. Matlab has this functionality via dataset class

http://www.mathworks.com/matlabcentral/answers/83204-add-row-column-names-to-a-matrix

One can use double(X) to convert dataset back to matrix.

Motorcycle Earphones

http://www.motorcycleearphones.com/

QT flush display

ui.uiname->repaint();

Creating thread with their id's

for(i=0;i < numthereads;i++)
workers.push_back(thread(&ThreadPool::thread_loop,this,i));

Place new object to specific location

To fill i th element of the array :
new (groups+i) Group();

Two small console debug tools

#define step() toc=tic;tic=GetTickCount();printf("Elapsed: %d\n",tic-toc);
#define pause() system("pause");

Matlab Single Value Default Function

function default(varargin)
   param = [varargin{:} ';'];
   ind = find(param=='=');
   stmt = 'if ~exist(''%s'',''var'');%s;end';
   str = sprintf(stmt,param(1:(ind(1)-1)),[varargin{:}]);
   evalin('caller', str);
end


Example use

default x=2

Matlab text that scales with figure size

text(0.52,0.52,'52','FontUnits','normalized','FontSize',0.11)

Good observation

"Just as machine learning algorithms can overfit by tuning a classifier’s parameters to the
accidental properties of a training set, a research community can overfit by refining algorithms that
have already done well on the existing data sets"



Lewis, D. D.; Yang, Y.; Rose, T.; and Li, F. RCV1: A New Benchmark Collection for Text Categorization Research. Journal of Machine Learning Research, 5:361-397, 2004. http://www.jmlr.org/papers/volume5/lewis04a/lewis04a.pdf

MS Word's Latex support

http://iun.edu/~mathiho/useful/word07shortcuts.pdf

Matlab Keyboard function

keyboard function is useful for debugging purposes. It stops execution of m file and allows user to watch and manipulate variables.

Reset Random Number Genaration of Matlab

reset(RandStream.getDefaultStream,sum(100*clock))
http://www.mathworks.com/support/solutions/en/data/1-18WH6/

Matlab Jit Acceleration

• Avoid sparse matrices
• Avoid static variables
• Vectorize the code
• Use scalar values in range of for loops
• Only call built in functions in for loops
• http://www.ee.columbia.edu/~marios/matlab/accel_matlab.pdf

Moving file to folder in HG versioning system

Just copy files into desired directory. Go into that directory and right click. Go to hg->guess renames. Rest is straightforward.

http://kiln.stackexchange.com/questions/1943/moving-a-file-in-a-repository

Semi Turing Test

A loosely definition for semi-Turing test is whether a human is capable to understand an output from human and output from computer aided human. For example If I am using spell checker , how someone can understand that I am doing so. It requires much more effort to distinguish.

A word

Aforementioned = Bahsi gecen

Exit code 0000135

Dll not found error

Lyx Bold

Ctrl + B

Matlab Long Simulation Interactive Debug , Set Debug flag using GUI , Pause execution to debug

Create a button function:


function util_DebugGuiButtons()
global debugFlag;
uicontrol('Position',[30 10 35 40],'String','||','Callback',@wait);
uicontrol('Position',[70 10 35 40],'String','>>','Callback',@dontwait);
function wait(hObject,eventdata)
debugFlag = 1;
end

function dontwait(hObject,eventdata)
debugFlag = 0;
dbcont;
end
end



Define in top of document:
global debugFlag


Put this inside your loop :


    if (debugFlag)
        dbstop in file.m at line
end



Continue Button is not working as desired now. It just clears the breakpoints but does not issue dbcont command properly. I will try to figure out later.