Set custom debugger for python

You can set PYTHONBREAKPOINT to set behaviour of breakpoint function. For example ipdb.set_trace. More Info

Computational Complexity

Even that the speed of a program is fast enough production it may not be fasy enough for experimentation. Because, you may need to many trials before settling the final configuration.

Blogger Phone App

Even that web interfaces are universal, still dedicated phone app from blogger makes it easy to post from phone.

x.99

We see x.99 prices everywhere. It is hacking human perception. Everybody does it does not mean that it is fair. I got an idea to develop a chrome extension that shows prices with x.99 by adding 1 cent on it.

C vs C++

Supposedly compatible to languages create problems in some cases. Recently I have faced cmath and stdlib do not work with each other. The compiler creates all sorts of strange errors.

Atan Sozler

Paslayan demir is tutmaz
Katlari diken, gulmeyi sever
Demleye demleye gel, olur
Balik yiyen bastan asagi kokar
Her et kusbasi yenmez
Yorgunsan yere ayagini uzat
Kupun darsa, sirke satma
Sakla zamani, kiymetli her ani

Git recover lost rebase

1. git reflog First identify the lost commit 2. git diff master commithash --name-only Check the differences in the files 3. git checkout commithash filepath Pick the one that you need

Get Json of Django Object

I found unnecessarily difficult to get json from django model object. Here is my simple solution to get that done.

def get_json_object(obj, fields): return {f:obj.__dict__[f] for f in fields}

New blog

I will post Machine Learning Deployments topic in my new blog. MLDeployments

No Real Style Transfer

Neural Networks are used to produce style transfer. But discrete structures are more difficult to generate. Here is my example. Does it resemble any picture to you?

Django + NGINX + USWGI

I was using "app" in the config, that was the reason why it did not work. Now converting to "application" it works. module=mysite.wsgi:application

Being Human

If you go to 20 generations before you are mixture of 2**20 ~ 1 million people.

TajweedMate v1 published

tajweedmate.com Android
Apple

CPPNs

Most of the time learning already known things is not a good idea in machine learning. Cppns are nice exceptions. Treat raster image as data and map coordinates to pixel values. The result is interesting, vector approximation of raster image. Better yet, multi layer function have potential to be more compact than pure vector lines.

Testing 3rd party api

Keeping the trials in a test suite for 3rd party api ensures consistency in later stages. a good suggedtion from book Clean Code

DRY Principle

I like the DRY (Do not repeat yourself) principle. In my words, do not copy-paste your code; use functions, modules, etc. to avoid that. This will reduce the point of maintenance. Wikipedia

Text to Speech in Browser

It would be a nice welcome, however I couldn't bypass user interaction requirement.

var msg = new SpeechSynthesisUtterance('Hi, Welcome'); window.speechSynthesis.speak(msg);

An update on resume

Resume

Do we really need Free Moving Windows ?

After using window managers many years I began to realize that most of the time we need grid manager. Moving windows freely serves only to create a layout which some of them would be visible. This could more effectively achieved by grid managers. https://www.w3schools.com/css/css_grid.asp

Lesson Land Online Lectures

lesson.land

tajweedmate.com

tajweedmate.com

Transform Your Negatives

Running Android on Kindle Paperwhite

I believe it is possible to run android on Kindle without rooting. The idea is using an emulator and a proxy service for Kindle's experimental browser.

An infinite loop

alist = [1] for a in alist: alist.append(a)

A little more freedom to kindle

I have recently stuck on being able to read android app based content on kindle. Kindle does not allow apps. Luckily app was allowing copy paste. I have used experimental browser and created a html page to display may clipboard. This allowed me to sync between my phone and kindle. I used "pre" tag for displaying text completely.

Yuzde Yuz

Yersiz derece yerlilik

Git Trick

https://stackoverflow.com/questions/9456550/how-to-find-the-n-largest-files-in-a-git-repository

Raster is memory, vector is intelligence

Our RCQA Workshop Paper

https://rcqa-ws.github.io/papers/paper8.pdf

Granite Countertops

https://unitedgranitepa.com/

Haber Cadiri

http://www.habercadiri.com/

Ignore White spaces in git

git diff --ignore-space-at-eol -b -w --ignore-blank-lines
https://coderwall.com/p/crj69a/from-a-useless-git-diff-to-a-useful-one

Python Counter

# collections.Counter lets you find the most common # elements in an iterable: >>> import collections >>> c = collections.Counter('helloworld') >>> c Counter({'l': 3, 'o': 2, 'e': 1, 'd': 1, 'h': 1, 'r': 1, 'w': 1}) >>> c.most_common(3) [('l', 3), ('o', 2), ('e', 1)] === https://realpython.com/

Python 3.7 debugging

Python 3.7 has internal function breakpoint(). It goes into pdb if it hits that function. https://www.python.org/dev/peps/pep-0553/

I just forgot to transpose

julia> x*x ERROR: MethodError: no method matching *(::Array{Int64,1}, ::Array{Int64,1}) Closest candidates are: *(::Any, ::Any, ::Any, ::Any...) at operators.jl:502 *(::LinearAlgebra.Adjoint{#s549,#s548} where #s548<:Union{DenseArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2}, ReinterpretArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, ReshapedArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, SubArray{T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64},2,A,I,L} where L where I<:Tuple{Vararg{Union{Int64, AbstractRange{Int64}, AbstractCartesianIndex},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, ReshapedArray{T,N,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}where N where T, DenseArray}} where #s549, ::Union{DenseArray{S,1}, ReinterpretArray{S,1,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, ReshapedArray{S,1,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray}, SubArray{S,1,A,I,L} where L where I<:Tuple{Vararg{Union{Int64, AbstractRange{Int64}, AbstractCartesianIndex},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, ReshapedArray{T,N,A,MI} where MI<:Tuple{Vararg{SignedMultiplicativeInverse{Int64},N} where N} where A<:Union{ReinterpretArray{T,N,S,A} where S where A<:Union{SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, SubArray{T,N,A,I,true} where I<:Tuple{AbstractUnitRange,Vararg{Any,N} where N} where A<:DenseArray where N where T, DenseArray} where N where T, DenseArray}}) where {T<:Union{Complex{Float32}, Complex{Float64}, Float32, Float64}, S} at C:\cygwin\home\Administrator\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.0\LinearAlgebra\src\matmul.jl:97 *(::LinearAlgebra.Adjoint{#s549,#s548} where #s548<:LinearAlgebra.AbstractTriangular where #s549, ::AbstractArray{T,1} where T) at C:\cygwin\home\Administrator\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.0\LinearAlgebra\src\triangular.jl:1805 ...Stacktrace: [1] top-level scope at none:0 julia> x*x'3×3 Array{Int64,2}: 1 2 3 2 4 6 3 6 9

3D multiplication with PyTorch https://pytorch.org/docs/stable/torch.html#torch.bmm

Complete Front End Deep Learning

Tensorflow publishes a front-end library that supports GPU training. https://js.tensorflow.org/

Purdue Online Writing Lab https://owl.english.purdue.edu/owl/

Metadata kept in Windows cache, refused to mount

I think this is related to hibernation. I have found the solution sudo ntfsfix /dev/sda(#)

Symmetric Dirichlet in d dimensions

function res=dirchrnd(alpha,d)
res = zeros(d,1);
for i=1:d
res(i)=gamrnd(alpha,1);
end
res=res/sum(res);
end

My new domain name

http://www.ideawarehouse.org

Short Shopping Cycle

One day project:

https://devpost.com/software/short-shopping-cycle?ref_content=contribution-prompt&ref_feature=engagement&ref_medium=email&utm_campaign=contribution-prompt&utm_content=contribution_reminder&utm_medium=email&utm_source=transactional#app-team

Juno Atom Julia v0.5

I received this error after updating Atom packages of Julia
"unknown package Juno required by Atom"

I attempt to solve using
Pkg.clone("https://github.com/JunoLab/Juno.jl.git")
Pkg.update()
using Atom

However, in next step Gallium gave an error.
I removed package Gallium and added again.

Then with existing installation of Atom, Julia works after precompilation finishes.

MATLAB Wrapper for Parallel Dirichlet Process Slice Sampler

https://www.mathworks.com/matlabcentral/fileexchange/59026-parallel-dirichlet-process-slice-sampler

Using Global Namespace functions

If you would like to use the global function while defining function with same name use this way :

Vector Vector::exp()
{
Vector& r = buffer.get();
for (int i = 0; i r.data[i] = ::exp(data[i]);
return buffer.next();
}

A julia implementation for Parallel Dirichlet Process Slice Sampler

https://github.com/halidziya/DPSliceSampler.jl

Nips Autosuggest for Overleaf

https://github.com/halidziya/NipsAutoSuggest

Peekaboo: Machine Learning Cheat Sheet (for scikit-learn)

Peekaboo: Machine Learning Cheat Sheet (for scikit-learn)

A useful roadmap maybe needs some updates

Configuring Matlab MEX for VS15

XML files located in matlabroot '\bin\win64\mexopts'
Compiler options also stored on those XML files
http://kaba.hilvi.org/homepage/blog/vs2015_in_matlab_2015/vs_2015_in_matlab_2015.htm

Hierarchical Latent Word Clustering

Our paper in NIPS BNP workshop.
https://sites.google.com/site/nipsbnp2015/accepted-papers
https://drive.google.com/file/d/0B1-Vx4o3v8xfVWZxd3pVeDFXeHc/view

Twitter Rate Limits

Twitter allows to capture 3200 tweets in the timeline.
A java program bypasses this limit using search system
https://github.com/Jefferson-Henrique/GetOldTweets

Bayesian Nonparametrics: The Next Generation

https://sites.google.com/site/nipsbnp2015/

Selecting Specific Elements in the matrix

Sometimes I would like to select elements in the Matlab matrix with their coordinate. However, if I used two arrays to get elements in Matlab it returns the rows and columns containing those elements. To get exact elements, I used following method where indx and indy is index coordinates:

A(sub2ind(size(A),indx,indy))

The Infinite Mixture of Infinite Gaussian Mixtures

http://papers.nips.cc/paper/5299-the-infinite-mixture-of-infinite-gaussian-mixtures

Matlab external programs in background

 system('start /b program.exe');

http://www.mathworks.com/matlabcentral/newsreader/view_thread/85377

Named rows and columns

R has built-in support for naming rows and columns for matrices. Matlab has this functionality via dataset class

http://www.mathworks.com/matlabcentral/answers/83204-add-row-column-names-to-a-matrix

One can use double(X) to convert dataset back to matrix.

Motorcycle Earphones

http://www.motorcycleearphones.com/

QT flush display

ui.uiname->repaint();

Creating thread with their id's

for(i=0;i < numthereads;i++)
workers.push_back(thread(&ThreadPool::thread_loop,this,i));

Place new object to specific location

To fill i th element of the array :
new (groups+i) Group();

Two small console debug tools

#define step() toc=tic;tic=GetTickCount();printf("Elapsed: %d\n",tic-toc);
#define pause() system("pause");

Matlab Single Value Default Function

function default(varargin)
   param = [varargin{:} ';'];
   ind = find(param=='=');
   stmt = 'if ~exist(''%s'',''var'');%s;end';
   str = sprintf(stmt,param(1:(ind(1)-1)),[varargin{:}]);
   evalin('caller', str);
end


Example use

default x=2

Matlab text that scales with figure size

text(0.52,0.52,'52','FontUnits','normalized','FontSize',0.11)

Good observation

"Just as machine learning algorithms can overfit by tuning a classifier’s parameters to the
accidental properties of a training set, a research community can overfit by refining algorithms that
have already done well on the existing data sets"



Lewis, D. D.; Yang, Y.; Rose, T.; and Li, F. RCV1: A New Benchmark Collection for Text Categorization Research. Journal of Machine Learning Research, 5:361-397, 2004. http://www.jmlr.org/papers/volume5/lewis04a/lewis04a.pdf

MS Word's Latex support

http://iun.edu/~mathiho/useful/word07shortcuts.pdf

Matlab Keyboard function

keyboard function is useful for debugging purposes. It stops execution of m file and allows user to watch and manipulate variables.

Reset Random Number Genaration of Matlab

reset(RandStream.getDefaultStream,sum(100*clock))
http://www.mathworks.com/support/solutions/en/data/1-18WH6/

Matlab Jit Acceleration

• Avoid sparse matrices
• Avoid static variables
• Vectorize the code
• Use scalar values in range of for loops
• Only call built in functions in for loops
• http://www.ee.columbia.edu/~marios/matlab/accel_matlab.pdf

Moving file to folder in HG versioning system

Just copy files into desired directory. Go into that directory and right click. Go to hg->guess renames. Rest is straightforward.

http://kiln.stackexchange.com/questions/1943/moving-a-file-in-a-repository

Semi Turing Test

A loosely definition for semi-Turing test is whether a human is capable to understand an output from human and output from computer aided human. For example If I am using spell checker , how someone can understand that I am doing so. It requires much more effort to distinguish.

A word

Aforementioned = Bahsi gecen

Exit code 0000135

Dll not found error

Lyx Bold

Ctrl + B

Matlab Long Simulation Interactive Debug , Set Debug flag using GUI , Pause execution to debug

Create a button function:


function util_DebugGuiButtons()
global debugFlag;
uicontrol('Position',[30 10 35 40],'String','||','Callback',@wait);
uicontrol('Position',[70 10 35 40],'String','>>','Callback',@dontwait);
function wait(hObject,eventdata)
debugFlag = 1;
end

function dontwait(hObject,eventdata)
debugFlag = 0;
dbcont;
end
end



Define in top of document:
global debugFlag


Put this inside your loop :


    if (debugFlag)
        dbstop in file.m at line
end



Continue Button is not working as desired now. It just clears the breakpoints but does not issue dbcont command properly. I will try to figure out later.

Comments on variables

Matlab displays comments of functions when you tend to use it. It would be good if it can show the comment of variables while holding mouse on top of variable name. This way can provide a tool to remember what each variable if for without using long descriptive variable names.

Yan cumle

points that are close to the decision boundary.

mouse and pencil

While being a student my life is accomodated with two items   mouse and pencil.So why we are not combining them . Put a wireless mouse pen to one side and put a pencil to other side. A gyro sensor can figure out if mouse is active.

Robot Dish Washer

It is difficult to create robot that cleans our arbitrary dirty dishes. However  , if we put some digital information on dishes (special designed for this machine) such as RFID , than robot can easily understand the shape , coordinates and features of the dish. In this way it will be easy to optimize the placement of the dishes based on current dirty dishes information.
I imagine we can create machine that has two part , first part is regular dish washer and second part is open area for dirty dishes and attached robot hands at top. It will increase the size of the machine , but it may worth , especially for big restaurants.

LDA PCA connection

"LDA can also be seen as a  type of principal component analysis for discrete data"

http://www.cs.princeton.edu/~blei/papers/Blei2012.pdf

MATLAB pass by reference

Handles handles the pass by reference issue in MATLAB.

http://www.mathworks.com/help/matlab/matlab_prog/copying-objects.html

Durable E ink display

http://www.eink.com/rugged.html

Is there a relation ?

Conservative - Underfitting
Liberal - Overfitting

Macro , Micro avarage, F-score,precision,recall

http://rushdishams.blogspot.com/2011/08/micro-and-macro-average-of-precision.html

Display Array in NetBeans

Netbeans uses GDB:

http://stackoverflow.com/questions/1651682/how-to-watch-a-c-dynamic-array-using-gdb

64 bit GSL

https://code.google.com/p/oscats/downloads/detail?name=gsl-1.15-dev-win64.zip&can=2&q=

Lazy Functions

I imagine compiler supported lazy functions that memorizes last value of return , then never computes it again until an input variable changes , maybe keeps states of input vars. This may help to reduce computation , when reads are more frequent than writes .  A flag could be set if there is any write to specified vars

Fetih 96 Space Game J2ME and Source Code

https://sourceforge.net/projects/fetih96/

D[i][j][k]stra's Algorithm

His name already gives idea about algorithm

R normalize data into 0-1 Interval

function normalize(data)
{
  maxvalues = apply(data,2,max)
  minvalues = apply(data,2,min)
  sweep(data,2,minvalues,"-")
  sweep(data,2,maxvalues-minvalues,"/")
}

R hold plot

There is no hold function R instead lines or points are used for that purpose :


plot(method1,type="l", main="Accuracy vs Number of Training samples",
      xlab="Number of samples", ylab="Accuracy",
      xlim=c(0, 30), ylim=c(0, 1))
lines(method2,col="blue")

Tanenbaum's Phrase

I liked the phrase "Researcher-push than demand-pull" in Tanenbaum's OS book.

Ogrenme

Ogrenme gecmis ile gelecegin iliskilendirilmesidir.

Possible Extensions for State of the Art Machine Learning Methods

-Relax the assumptions
-Put in a hierarchy
-Semi,hybrid version
-Active,online version
-Better performance
-Relation with other methods
-More efficient
-A more general version
-Application on more realistic problem or different domain

Evalution metrics using Javascript

function getEvaluationMetrics(tp,fp,tn,fn){ 
precision=(tp/(tp+fp)); 
recall=(tp/(tp+fn)); 
f1=2*(precision*recall/(precision+recall)); 
var m= new Array(3); m[0]=precision; m[1]=recall; m[2]=f1; 
return m; 
}

Paradox

nothing is exactly true -> Altough we observe many things that is not perfect , this hypothesis could not be true for any hypothesis set.

Logistic Fit

http://www.mathworks.com/help/stats/glmfit.html
http://nlp.stanford.edu/~manning/courses/ling289/logistic.pdf

R/Matlab Anonymous functions

R for variable X:
means <- function(x)  rnorm(1,x)

Matlab
means = @(x) x+randn(1)

Stationary distribution , probability flow analogy

In page rank we are multiplying Transpose Adjacency matrix with current page rank vector. If the result is stationary distribution it means it will converge and all values will stay same. We can think this as incoming probability to a node is equal to outgoing probability.


For detailed balance condition T(x'->x)P(x') = T(x->x')P(x) if the graph is undirected
So total flow of x' times fraction of flow to x T(x'->x) is equal to total flow of x times the fraction of flow from x to x' is equal means incoming and outgoing probability flow in the full duplex edge.

It is possible that, this concept is already originating from real physical phenomena such as fluid flow or air flow.

Bayesian F1

Decision theory considers  the posterior probability to decide which class to chose , or weight using a cost function. However in this setting its objective is the accuracy. Most often we are more interested in more balanced measures such as F1 due to skewed classes. How would be F1 maximizer Bayesian decision mechanism if the distribution is exactly known ? I guess this is already implemented in somewhere , however I didn't face it yet.

Latex 2 column figure

\begin{figure*}[ht]
\vskip 0.2in
\begin{center}
\centerline{\includegraphics[width=2\columnwidth]{NAME}}
\caption{NAME}
\end{center}
\vskip -0.2in
\end{figure*}