TajweedMate v1 published

tajweedmate.com Android
Apple

CPPNs

Most of the time learning already known things is not a good idea in machine learning. Cppns are nice exceptions. Treat raster image as data and map coordinates to pixel values. The result is interesting, vector approximation of raster image. Better yet, multi layer function have potential to be more compact than pure vector lines.

Testing 3rd party api

Keeping the trials in a test suite for 3rd party api ensures consistency in later stages. a good suggedtion from book Clean Code

DRY Principle

I like the DRY (Do not repeat yourself) principle. In my words, do not copy-paste your code; use functions, modules, etc. to avoid that. This will reduce the point of maintenance. Wikipedia

Text to Speech in Browser

It would be a nice welcome, however I couldn't bypass user interaction requirement.

var msg = new SpeechSynthesisUtterance('Hi, Welcome'); window.speechSynthesis.speak(msg);

An update on resume

Resume

Do we really need Free Moving Windows ?

After using window managers many years I began to realize that most of the time we need grid manager. Moving windows freely serves only to create a layout which some of them would be visible. This could more effectively achieved by grid managers. https://www.w3schools.com/css/css_grid.asp

Lesson Land Online Lectures

lesson.land

tajweedmate.com

tajweedmate.com

Transform Your Negatives

Running Android on Kindle Paperwhite

I believe it is possible to run android on Kindle without rooting. The idea is using an emulator and a proxy service for Kindle's experimental browser.

An infinite loop

alist = [1] for a in alist: alist.append(a)

A little more freedom to kindle

I have recently stuck on being able to read android app based content on kindle. Kindle does not allow apps. Luckily app was allowing copy paste. I have used experimental browser and created a html page to display may clipboard. This allowed me to sync between my phone and kindle. I used "pre" tag for displaying text completely.

Yuzde Yuz

Yersiz derece yerlilik

Git Trick

https://stackoverflow.com/questions/9456550/how-to-find-the-n-largest-files-in-a-git-repository

Raster is memory, vector is intelligence

Our RCQA Workshop Paper

https://rcqa-ws.github.io/papers/paper8.pdf

Granite Countertops

https://unitedgranitepa.com/

Haber Cadiri

http://www.habercadiri.com/

Ignore White spaces in git

git diff --ignore-space-at-eol -b -w --ignore-blank-lines
https://coderwall.com/p/crj69a/from-a-useless-git-diff-to-a-useful-one

Python Counter

# collections.Counter lets you find the most common # elements in an iterable: >>> import collections >>> c = collections.Counter('helloworld') >>> c Counter({'l': 3, 'o': 2, 'e': 1, 'd': 1, 'h': 1, 'r': 1, 'w': 1}) >>> c.most_common(3) [('l', 3), ('o', 2), ('e', 1)] === https://realpython.com/

Python 3.7 debugging

Python 3.7 has internal function breakpoint(). It goes into pdb if it hits that function. https://www.python.org/dev/peps/pep-0553/

I just forgot to transpose

julia> x*x ERROR: MethodError: no method matching *(::Array{Int64,1}, ::Array{Int64,1}) Closest candidates are: *(::Any, ::Any, ::Any, ::Any...) at operators.jl:502 *(::LinearAlgebra.Adjoint{#s549,#s548} where #s548<:Union{DenseArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2}, ReinterpretArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, ReshapedArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, SubArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2,A,I,L} where L where I<:Tuple{Vararg{Union{Int64, AbstractRange{Int64}, AbstractCartesianIndex},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, ReshapedArray{T,N,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}where N where T, DenseArray}} where #s549, ::Union{DenseArray{S,1}, ReinterpretArray{S,1,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, ReshapedArray{S,1,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, SubArray{S,1,A,I,L} where L where I<:Tuple{Vararg{Union{Int64, AbstractRange{Int64}, AbstractCartesianIndex},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, ReshapedArray{T,N,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, DenseArray}}) where {T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64}, S} at C:\cygwin\home\Administrator\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.0\LinearAlgebra\src\matmul.jl:97 *(::LinearAlgebra.Adjoint{#s549,#s548} where #s548<:LinearAlgebra.AbstractTriangular where #s549, ::AbstractArray{T,1} where T) at C:\cygwin\home\Administrator\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.0\LinearAlgebra\src\triangular.jl:1805 ...Stacktrace: [1] top-level scope at none:0 julia> x*x'3×3 Array{Int64,2}: 1 2 3 2 4 6 3 6 9

3D multiplication with PyTorch https://pytorch.org/docs/stable/torch.html#torch.bmm

Complete Front End Deep Learning

Tensorflow publishes a front-end library that supports GPU training. https://js.tensorflow.org/

Purdue Online Writing Lab https://owl.english.purdue.edu/owl/

Metadata kept in Windows cache, refused to mount

I think this is related to hibernation. I have found the solution sudo ntfsfix /dev/sda(#)

Symmetric Dirichlet in d dimensions

function res=dirchrnd(alpha,d)
res = zeros(d,1);
for i=1:d
res(i)=gamrnd(alpha,1);
end
res=res/sum(res);
end

My new domain name

http://www.ideawarehouse.org

Short Shopping Cycle

One day project:

https://devpost.com/software/short-shopping-cycle?ref_content=contribution-prompt&ref_feature=engagement&ref_medium=email&utm_campaign=contribution-prompt&utm_content=contribution_reminder&utm_medium=email&utm_source=transactional#app-team

Juno Atom Julia v0.5

I received this error after updating Atom packages of Julia
"unknown package Juno required by Atom"

I attempt to solve using
Pkg.clone("https://github.com/JunoLab/Juno.jl.git")
Pkg.update()
using Atom

However, in next step Gallium gave an error.
I removed package Gallium and added again.

Then with existing installation of Atom, Julia works after precompilation finishes.

MATLAB Wrapper for Parallel Dirichlet Process Slice Sampler

https://www.mathworks.com/matlabcentral/fileexchange/59026-parallel-dirichlet-process-slice-sampler

Using Global Namespace functions

If you would like to use the global function while defining function with same name use this way :

Vector Vector::exp()
{
Vector& r = buffer.get();
for (int i = 0; i r.data[i] = ::exp(data[i]);
return buffer.next();
}

A julia implementation for Parallel Dirichlet Process Slice Sampler

https://github.com/halidziya/DPSliceSampler.jl

Nips Autosuggest for Overleaf

https://github.com/halidziya/NipsAutoSuggest

Peekaboo: Machine Learning Cheat Sheet (for scikit-learn)

Peekaboo: Machine Learning Cheat Sheet (for scikit-learn)

A useful roadmap maybe needs some updates

Configuring Matlab MEX for VS15

XML files located in matlabroot '\bin\win64\mexopts'
Compiler options also stored on those XML files
http://kaba.hilvi.org/homepage/blog/vs2015_in_matlab_2015/vs_2015_in_matlab_2015.htm

Hierarchical Latent Word Clustering

Our paper in NIPS BNP workshop.
https://sites.google.com/site/nipsbnp2015/accepted-papers
https://drive.google.com/file/d/0B1-Vx4o3v8xfVWZxd3pVeDFXeHc/view

Twitter Rate Limits

Twitter allows to capture 3200 tweets in the timeline.
A java program bypasses this limit using search system
https://github.com/Jefferson-Henrique/GetOldTweets

Bayesian Nonparametrics: The Next Generation

https://sites.google.com/site/nipsbnp2015/

Selecting Specific Elements in the matrix

Sometimes I would like to select elements in the Matlab matrix with their coordinate. However, if I used two arrays to get elements in Matlab it returns the rows and columns containing those elements. To get exact elements, I used following method where indx and indy is index coordinates:

A(sub2ind(size(A),indx,indy))

The Infinite Mixture of Infinite Gaussian Mixtures

http://papers.nips.cc/paper/5299-the-infinite-mixture-of-infinite-gaussian-mixtures

Matlab external programs in background

 system('start /b program.exe');

http://www.mathworks.com/matlabcentral/newsreader/view_thread/85377

Named rows and columns

R has built-in support for naming rows and columns for matrices. Matlab has this functionality via dataset class

http://www.mathworks.com/matlabcentral/answers/83204-add-row-column-names-to-a-matrix

One can use double(X) to convert dataset back to matrix.

Motorcycle Earphones

http://www.motorcycleearphones.com/

QT flush display

ui.uiname->repaint();

Creating thread with their id's

for(i=0;i < numthereads;i++)
workers.push_back(thread(&ThreadPool::thread_loop,this,i));

Place new object to specific location

To fill i th element of the array :
new (groups+i) Group();

Two small console debug tools

#define step() toc=tic;tic=GetTickCount();printf("Elapsed: %d\n",tic-toc);
#define pause() system("pause");

Matlab Single Value Default Function

function default(varargin)
   param = [varargin{:} ';'];
   ind = find(param=='=');
   stmt = 'if ~exist(''%s'',''var'');%s;end';
   str = sprintf(stmt,param(1:(ind(1)-1)),[varargin{:}]);
   evalin('caller', str);
end


Example use

default x=2

Matlab text that scales with figure size

text(0.52,0.52,'52','FontUnits','normalized','FontSize',0.11)

Good observation

"Just as machine learning algorithms can overfit by tuning a classifier’s parameters to the
accidental properties of a training set, a research community can overfit by refining algorithms that
have already done well on the existing data sets"



Lewis, D. D.; Yang, Y.; Rose, T.; and Li, F. RCV1: A New Benchmark Collection for Text Categorization Research. Journal of Machine Learning Research, 5:361-397, 2004. http://www.jmlr.org/papers/volume5/lewis04a/lewis04a.pdf

MS Word's Latex support

http://iun.edu/~mathiho/useful/word07shortcuts.pdf

Matlab Keyboard function

keyboard function is useful for debugging purposes. It stops execution of m file and allows user to watch and manipulate variables.

Reset Random Number Genaration of Matlab

reset(RandStream.getDefaultStream,sum(100*clock))
http://www.mathworks.com/support/solutions/en/data/1-18WH6/

Matlab Jit Acceleration

• Avoid sparse matrices
• Avoid static variables
• Vectorize the code
• Use scalar values in range of for loops
• Only call built in functions in for loops
• http://www.ee.columbia.edu/~marios/matlab/accel_matlab.pdf

Moving file to folder in HG versioning system

Just copy files into desired directory. Go into that directory and right click. Go to hg->guess renames. Rest is straightforward.

http://kiln.stackexchange.com/questions/1943/moving-a-file-in-a-repository

Semi Turing Test

A loosely definition for semi-Turing test is whether a human is capable to understand an output from human and output from computer aided human. For example If I am using spell checker , how someone can understand that I am doing so. It requires much more effort to distinguish.

A word

Aforementioned = Bahsi gecen

Exit code 0000135

Dll not found error

Lyx Bold

Ctrl + B

Matlab Long Simulation Interactive Debug , Set Debug flag using GUI , Pause execution to debug

Create a button function:


function util_DebugGuiButtons()
global debugFlag;
uicontrol('Position',[30 10 35 40],'String','||','Callback',@wait);
uicontrol('Position',[70 10 35 40],'String','>>','Callback',@dontwait);
function wait(hObject,eventdata)
debugFlag = 1;
end

function dontwait(hObject,eventdata)
debugFlag = 0;
dbcont;
end
end



Define in top of document:
global debugFlag


Put this inside your loop :


    if (debugFlag)
        dbstop in file.m at line
end



Continue Button is not working as desired now. It just clears the breakpoints but does not issue dbcont command properly. I will try to figure out later.

Comments on variables

Matlab displays comments of functions when you tend to use it. It would be good if it can show the comment of variables while holding mouse on top of variable name. This way can provide a tool to remember what each variable if for without using long descriptive variable names.

Yan cumle

points that are close to the decision boundary.

mouse and pencil

While being a student my life is accomodated with two items   mouse and pencil.So why we are not combining them . Put a wireless mouse pen to one side and put a pencil to other side. A gyro sensor can figure out if mouse is active.

Robot Dish Washer

It is difficult to create robot that cleans our arbitrary dirty dishes. However  , if we put some digital information on dishes (special designed for this machine) such as RFID , than robot can easily understand the shape , coordinates and features of the dish. In this way it will be easy to optimize the placement of the dishes based on current dirty dishes information.
I imagine we can create machine that has two part , first part is regular dish washer and second part is open area for dirty dishes and attached robot hands at top. It will increase the size of the machine , but it may worth , especially for big restaurants.

LDA PCA connection

"LDA can also be seen as a  type of principal component analysis for discrete data"

http://www.cs.princeton.edu/~blei/papers/Blei2012.pdf

MATLAB pass by reference

Handles handles the pass by reference issue in MATLAB.

http://www.mathworks.com/help/matlab/matlab_prog/copying-objects.html

Durable E ink display

http://www.eink.com/rugged.html

Is there a relation ?

Conservative - Underfitting
Liberal - Overfitting

Macro , Micro avarage, F-score,precision,recall

http://rushdishams.blogspot.com/2011/08/micro-and-macro-average-of-precision.html

Display Array in NetBeans

Netbeans uses GDB:

http://stackoverflow.com/questions/1651682/how-to-watch-a-c-dynamic-array-using-gdb

64 bit GSL

https://code.google.com/p/oscats/downloads/detail?name=gsl-1.15-dev-win64.zip&can=2&q=

Lazy Functions

I imagine compiler supported lazy functions that memorizes last value of return , then never computes it again until an input variable changes , maybe keeps states of input vars. This may help to reduce computation , when reads are more frequent than writes .  A flag could be set if there is any write to specified vars

Fetih 96 Space Game J2ME and Source Code

https://sourceforge.net/projects/fetih96/

D[i][j][k]stra's Algorithm

His name already gives idea about algorithm

R normalize data into 0-1 Interval

function normalize(data)
{
  maxvalues = apply(data,2,max)
  minvalues = apply(data,2,min)
  sweep(data,2,minvalues,"-")
  sweep(data,2,maxvalues-minvalues,"/")
}

R hold plot

There is no hold function R instead lines or points are used for that purpose :


plot(method1,type="l", main="Accuracy vs Number of Training samples",
      xlab="Number of samples", ylab="Accuracy",
      xlim=c(0, 30), ylim=c(0, 1))
lines(method2,col="blue")

Tanenbaum's Phrase

I liked the phrase "Researcher-push than demand-pull" in Tanenbaum's OS book.

Ogrenme

Ogrenme gecmis ile gelecegin iliskilendirilmesidir.

Possible Extensions for State of the Art Machine Learning Methods

-Relax the assumptions
-Put in a hierarchy
-Semi,hybrid version
-Active,online version
-Better performance
-Relation with other methods
-More efficient
-A more general version
-Application on more realistic problem or different domain

Evalution metrics using Javascript

function getEvaluationMetrics(tp,fp,tn,fn){ 
precision=(tp/(tp+fp)); 
recall=(tp/(tp+fn)); 
f1=2*(precision*recall/(precision+recall)); 
var m= new Array(3); m[0]=precision; m[1]=recall; m[2]=f1; 
return m; 
}

Paradox

nothing is exactly true -> Altough we observe many things that is not perfect , this hypothesis could not be true for any hypothesis set.

Logistic Fit

http://www.mathworks.com/help/stats/glmfit.html
http://nlp.stanford.edu/~manning/courses/ling289/logistic.pdf

R/Matlab Anonymous functions

R for variable X:
means <- function(x)  rnorm(1,x)

Matlab
means = @(x) x+randn(1)

Stationary distribution , probability flow analogy

In page rank we are multiplying Transpose Adjacency matrix with current page rank vector. If the result is stationary distribution it means it will converge and all values will stay same. We can think this as incoming probability to a node is equal to outgoing probability.


For detailed balance condition T(x'->x)P(x') = T(x->x')P(x) if the graph is undirected
So total flow of x' times fraction of flow to x T(x'->x) is equal to total flow of x times the fraction of flow from x to x' is equal means incoming and outgoing probability flow in the full duplex edge.

It is possible that, this concept is already originating from real physical phenomena such as fluid flow or air flow.

Bayesian F1

Decision theory considers  the posterior probability to decide which class to chose , or weight using a cost function. However in this setting its objective is the accuracy. Most often we are more interested in more balanced measures such as F1 due to skewed classes. How would be F1 maximizer Bayesian decision mechanism if the distribution is exactly known ? I guess this is already implemented in somewhere , however I didn't face it yet.

Latex 2 column figure

\begin{figure*}[ht]
\vskip 0.2in
\begin{center}
\centerline{\includegraphics[width=2\columnwidth]{NAME}}
\caption{NAME}
\end{center}
\vskip -0.2in
\end{figure*}

More appealing

Novel, hierarchical , jointly learning , hybrid , semi supervised , hyper-parameters , large data , distributed , active , cost sensitive.

Training , Validation , Test set , A more general case

A regular practice is dividing training data into tree parts to evaluate the performance of the algorithm. Training set is used to train  parameters of the model. Validation set is used to "train" hyper parameters of the model and test set is used to evaluate the model.
     For more general sense what if I divide my training set into n part and use first set to bottom level parameters  for the tree (One can use topological sort in graphical model) of the parameters. Than iterate next upper level training upper level parameters in next set. At the end we would have no parameters above the top which corresponds to a test set. Basically , make the distinction between parameters and hyper parameters fuzzy.

Polynomial multiplication , base x

For representing polynomials we can use base notation , it will make some operation easier.
for example 1+x+x^2 = (111)_x

For multiplication (x+1) * (x+1) = x^2 + 2x + 1
We can represent as (11)_x + (11)_x = (121)_x
It becomes like a regular multiplication if it does not excess 10 for one digit , but if it does than we need to seperate number e.g. (1,13,1)_x = x^2 + 13x + 1
We can assume at this point x > R (all real numbers) in base notation.

Robot Particles Display:

Current display devices can show any image for a very cheap price. But it will be very intresting if someone tries to implement display using multiple robots. For example each robot will have fixed color and will stay in rectengular area. After input comes the positions of the robots will change to approximate the given image input. If this could be done in 2D in Earth. It could be extentable 3D in space since gravity no longer becomes a problem. That will result real 3D display using robotic particles. A good science finction scenario :).

It would be possible to describe everything scientifically, but it would make no sense; it would be without meaning, as if you described a Beethoven symphony as a variation of wave pressure.

Albert Einstein

Power Law

What is the relation between power law behavior and TF.Idf frequencies. They are supporting each other.

Arbitrary Complexity PageRank-Prestige

Prestige :

A

Page Rank:

 

A + A_f 

Hub - Authority :

HITS algorithm - Incoming -> Authority , Outgoing -> Hub 

Arbitrary  :

Hub Authority + Unknown L class if pointed by Hubs the more the L it is and if A pointed by L the more the Authority it is (Or maybe having too many Hubs makes L strong). You can define anything.

The question is for a real world scoring could we find a optimum score graph given a large data ? Since no true score value exist for arbitrary model there is no criteria for evaluation yet.   

KNN

       KNN comes from very basic idea. "Look at the closer samples", the science behind this classifier how it is proven to be useful. I mean , If you just come up with an heuristic which is not proven  it does not have big impact.

Javascript Infinity loop

I don't want to forget this :

I used for loop in my recursive calls using i variable



function recursive(param)
{
//Some stuff
        for (i=0;i            recursive(otherparam)
}

It was creating  infinity loop. The problem that I realized is i is behaving like and global variable , thus creating an infinity loop.

Fix by :

for (var i=0;i</*A Value*/;i++)

http://en.wiktionary.org/wiki/mispelling mispelling Common misspelling of misspelling.

Prime Graphs: There are some efficent algorithms for restricted set of graphs for NP hard problems. It gives me the intuition that there are core graph of those restricted set which divides all elements in their set (Altough division is not defined yet). In this sense there exist an algorithm which solves this restricted set efficiently by solving its core problem. These core's are called prime graphs which is analogous to prime numbers where prime number has their unique divisors. Division means that there is polynomial algorithm that can convert problem into solution or core problem. To solve those prime graphs an machine need to be started to solve and store them. Then anyone who needs a solution to their problem need to find a conversion to prime graph and query from already solved graphs. This is different from polynomial time conversion from one problem type to another. This time the iteration held on graphs as similar to numbers.

Symmetric IUPUI:IUΦUI