Friday, 30 March 2018

python - Extract First Name, Middle Name and Last Name

Input: 

       You need to read a line from STDIN to extract First Name, Middle Name and Last Name

Output: 

       First Name, Middle Name and Last Name (separated by a single comma)

Test Cases:

Input: Velraj Kutralam
Output: Velraj,,Kutralam

Input: vel raj kutralam
Output: vel,raj,kutralam

Program:

#input function in Python 2.7, evaluates whatever your enter, as a Python expression(that is python variable).
# If you simply want to read strings, then use raw_input function in Python 2.7, which will not evaluate the read strings.
line = raw_input("Enter the string:")
print line
#comma = ','.join(line)

spl = line.split()      # convert the list of array into an separated string
print spl
spl_for_com = spl[:3]  # copy the first 3 string
print spl_for_com

leng = len(spl_for_com)
#print leng

if(leng == 2):
    join = ',,'.join(spl_for_com)
else:
    join = ','.join(spl_for_com)

remainin = ' '.join(spl[3:])
#remainin = spl[3:].split()
result = join + ' ' + remainin
print "After join = %s " % result
print "Read value = %s " % line


Output:

$ python readStdin-str-opr.py
Enter the string:velraj kutralam
velraj kutralam
['velraj', 'kutralam']
['velraj', 'kutralam']
After join = velraj,,kutralam
Read value = velraj kutralam

Thursday, 29 March 2018

How to use gprof tool


How to use gprof tool

  • Profiling can determine the parts in program code that are time consuming and need to be re-written.
  • This helps make your program execution faster which is always desired.

The following 3 steps are used to get the gprof output:

  • Have profiling enabled while compiling the code
  • Execute the program code to produce the profiling data
  • Run the gprof tool on the profiling data file (generated in the step above).

Step 1 - Have profiling enabled while compiling the code

  • Profiling enabled while compilation
  • Add ‘-pg’ option in the compilation step
    • Usage: gcc -pg gprof_test.c gprof_test_2.c -o out_gprof

Step 2 - Execute the program code to produce the profiling data

  • Execute the binary code
Step 3 - Run the gprof tool on the profiling data file (generated in the step above).

  • In this step, the gprof tool is run with the executable name and the above generated ‘gmon.out’ as argument. 
    • Usage: gprof out_gprof gmon.out > gprof_result

Example Code:

File 1:

//test_gprof.c
#include<stdio.h>
#include<stdlib.h>

extern void new_func1(void);

void func1(void)
{
    printf("\n Inside func1 \n");
    int i = 0;

    //exit(0);       // Even if we exit, gmon.out file will be generated
    sleep(10);           // sleeps are not calculated in the result
    for(;i<0xffffffff;i++);
    new_func1();

    return;
}

static void func2(void)
{
    printf("\n Inside func2 \n");
    int i = 0;

    for(;i<0xffffffaa;i++);
    return;
}

int main(void)
{
    printf("\n Inside main()\n");
    int i = 0;

    for(;i<0xffffff;i++);
    func1();
    func2();

    return 0;
}

File 2:

//test_gprof_new.c
#include<stdio.h>

void new_func1(void)
{
    printf("\n Inside new_func1()\n");
    int i = 0;

    for(;i<0xffffffee;i++);

    return;
}

Output:

Flat profile:

Each sample counts as 0.01 seconds.
  %   cumulative   self              self     total
 time   seconds   seconds    calls   s/call   s/call  name
 34.24     10.39    10.39        1    10.39    20.49  func1
 33.47     20.54    10.16        1    10.16    10.16  func2
 33.31     30.65    10.10        1    10.10    10.10  new_func1
  0.13     30.69     0.04                             main

 %         the percentage of the total running time of the
time       program used by this function.

cumulative a running sum of the number of seconds accounted
 seconds   for by this function and those listed above it.

 self      the number of seconds accounted for by this
seconds    function alone.  This is the major sort for this
           listing.

calls      the number of times this function was invoked, if
           this function is profiled, else blank.

 self      the average number of milliseconds spent in this
ms/call    function per call, if this function is profiled,
           else blank.

 total     the average number of milliseconds spent in this
ms/call    function and its descendents per call, if this
           function is profiled, else blank.

name       the name of the function.  This is the minor sort
           for this listing. The index shows the location of
           the function in the gprof listing. If the index is
           in parenthesis it shows where it would appear in
           the gprof listing if it were to be printed.
^L
Copyright (C) 2012 Free Software Foundation, Inc.

Copying and distribution of this file, with or without modification,
are permitted in any medium without royalty provided the copyright
notice and this notice are preserved.
^L
                     Call graph (explanation follows)

granularity: each sample hit covers 2 byte(s) for 0.03% of 30.69 seconds

index % time    self  children    called     name
                                                 <spontaneous>
[1]    100.0    0.04   30.65                 main [1]
               10.39   10.10       1/1           func1 [2]
               10.16    0.00       1/1           func2 [3]
-----------------------------------------------
               10.39   10.10       1/1           main [1]
[2]     66.8   10.39   10.10       1         func1 [2]
               10.10    0.00       1/1           new_func1 [4]
-----------------------------------------------
               10.16    0.00       1/1           main [1]
[3]     33.1   10.16    0.00       1         func2 [3]
-----------------------------------------------
               10.10    0.00       1/1           func1 [2]
[4]     32.9   10.10    0.00       1         new_func1 [4]
-----------------------------------------------

 This table describes the call tree of the program, and was sorted by
 the total amount of time spent in each function and its children.

 Each entry in this table consists of several lines.  The line with the
 index number at the left hand margin lists the current function.
 The lines above it list the functions that called this function,
 and the lines below it list the functions this one called.
 This line lists:
     index      A unique number given to each element of the table.
                Index numbers are sorted numerically.
                The index number is printed next to every function name so
                it is easier to look up where the function is in the table.

     % time     This is the percentage of the `total' time that was spent
                in this function and its children.  Note that due to
                different viewpoints, functions excluded by options, etc,
                these numbers will NOT add up to 100%.

     self       This is the total amount of time spent in this function.

     children   This is the total amount of time propagated into this
                function by its children.
     called     This is the number of times the function was called.
                If the function called itself recursively, the number
                only includes non-recursive calls, and is followed by
                a `+' and the number of recursive calls.

     name       The name of the current function.  The index number is
                printed after it.  If the function is a member of a
                cycle, the cycle number is printed between the
                function's name and the index number.


 For the function's parents, the fields have the following meanings:

     self       This is the amount of time that was propagated directly
                from the function into this parent.

     children   This is the amount of time that was propagated from
                the function's children into this parent.

     called     This is the number of times this parent called the
                function `/' the total number of times the function
                was called.  Recursive calls to the function are not
                included in the number after the `/'.

     name       This is the name of the parent.  The parent's index
                number is printed after it.  If the parent is a
                member of a cycle, the cycle number is printed between
                the name and the index number.

 If the parents of the function cannot be determined, the word
 `<spontaneous>' is printed in the `name' field, and all the other
 fields are blank.

 For the function's children, the fields have the following meanings:
     self       This is the amount of time that was propagated directly
                from the child into the function.

     children   This is the amount of time that was propagated from the
                child's children to the function.

     called     This is the number of times the function called
                this child `/' the total number of times the child
                was called.  Recursive calls by the child are not
                listed in the number after the `/'.

     name       This is the name of the child.  The child's index
                number is printed after it.  If the child is a
                member of a cycle, the cycle number is printed
                between the name and the index number.

 If there are any cycles (circles) in the call graph, there is an
 entry for the cycle-as-a-whole.  This entry shows who called the
 cycle (as parents) and the members of the cycle (as children.)
 The `+' recursive calls entry shows the number of function calls that
 were internal to the cycle, and the calls entry for each member shows,
 for that member, how many times it was called from other members of
 the cycle.
^L
Copyright (C) 2012 Free Software Foundation, Inc.

Copying and distribution of this file, with or without modification,
are permitted in any medium without royalty provided the copyright
notice and this notice are preserved.
^L
Index by function name

   [2] func1                   [1] main
   [3] func2                   [4] new_func1


To verify gprof is add in binary:

gprof$ nm out_gprof | grep gmon
0000000000400590 T __gmon_start__
        gprof$ nm out_gprof | grep clea
                 U _mcleanup@@GLIBC_2.2.5

Thursday, 22 March 2018

how to display the tuples in kernel


how to display the tuples in kernel:

Use %pI4 to print the ip address from kernel.

static inline void vel_nf_ct_dump_tuple_ip(const struct nf_conntrack_tuple *t, char *name)
{
    printk("Vel %s %s  %p: dst proto = %u src = %pI4:%hu -> dst = %pI4:%hu src l3num = %d \n", __FUNCTION__, name,
            t, t->dst.protonum,
            &t->src.u3.ip, ntohs(t->src.u.all),
            &t->dst.u3.ip, ntohs(t->dst.u.all), t->src.l3num);
}

Output:


Thursday, 15 March 2018

Calculate the elapsed time of particular block of code in C

Calculate the time of particular block of the code. This time used to validate the execution time of the program of particular block of code.

Example:

#include <stdio.h>
#include <sys/time.h>

void elapsed_time_display(struct timeval *start, struct timeval *end, char *time_for)
{
    double elapsed = 0;
    elapsed = (end->tv_sec - start->tv_sec) +
                      ((end->tv_usec - start->tv_usec)/1000000.0);
    printf("\n\n\t\tVel Elapsed %s time in second = %f  second= %d Microsecond = %d \n",time_for, elapsed, (int)(end->tv_sec - start->tv_sec), (int)(end->tv_usec - start->tv_usec));
}

int main()
{
    struct timeval time_start, time_end;
    int i = 0;
    gettimeofday(&time_start,NULL);
    printf("Calculate printf time\n");
    gettimeofday(&time_end,NULL);
    elapsed_time_display(&time_start, &time_end, "printf");
    gettimeofday(&time_start,NULL);
    while(i < 10000000) {
        i++;
    }
    gettimeofday(&time_end,NULL);
    elapsed_time_display(&time_start, &time_end, "while");

    return 0;
}

Output:

Calculate printf time

                Vel Elapsed printf time in second = 0.000014  second= 0 Microsecond = 14

                Vel Elapsed while time in second = 0.023843  second= 0 Microsecond = 23843


Friday, 5 January 2018

Client and Server Interaction with UDP


Client and Server Interaction with UDP

UDP (User Datagram Protocol)

  1. It uses a simple connectionless communication
  2. provides checksums for data integrity
  3. Port numbers for addressing different functions at the source and destination of the datagram.
  4. There is no guarantee of delivery, ordering, or duplicate protection.
  5. UDP avoids the overhead of such processing in the protocol stack

Real Time example:

TCP:
        World Wide Web(HTTP)
        E-mail (SMTP TCP)
        File Transfer Protocol (FTP)
        Secure Shell (SSH)
UDP:
         Domain Name System (DNS)
         Streaming media applications such as movies
         Online multiplayer games
         Voice over IP (VoIP)
         Trivial File Transfer Protocol (TFTP)

Real Time Applications for TCP:

Email:
       Reason: suppose if some packet(words/statement) is missing we cannot understand the content.It should be reliable.

Real Time Application for UDP:

video streaming:
        * **Reason: ***suppose if some packet(frame/sequence) is missing we can understand the content.Because video is collection of frames.For 1 second video there should be 25 frames(image).Even though we can understand some frames are missing due to our imagination skills. Thats why UDP is used for video streaming.

Example UDP server Program:

// Server side C/C++ program to demonstrate Socket programming
#include <stdio.h>
#include <sys/socket.h>
#include <stdlib.h>
#include <netinet/in.h>
#include <string.h>
#define PORT 8000

#include <pthread.h>
#include <errno.h>
#include <sys/ioctl.h>

struct sockaddr_in address;

void *thread_receiver(void *sock)
{
    int valread = 0;
    char buffer[1024];
    socklen_t addr_size = 0;
    struct sockaddr_in serv_addr;
    //char *cli_addr;
    char cli_addr[INET_ADDRSTRLEN];

    addr_size = sizeof(address);
    while(1) {
        memset(buffer,0, sizeof(buffer));
        if((valread = recvfrom((*(int *)sock), buffer, 1024, 0, (struct sockaddr *)&address,&addr_size)) < 0 ) {
            perror("Error in receiving : ");
        }

        *cli_addr = inet_ntoa(address.sin_addr);
        inet_ntop(AF_INET, &address.sin_addr, cli_addr, INET_ADDRSTRLEN);
        printf("Client details = %s \n",cli_addr);

#if 0
        // zero indicates end of file
        if(valread == 0) {
            printf("\n\n The client process is terminated so closing the connection \n");
            exit(0);
        }
#endif

        printf("\nVel Server received no of bytes = (%d) Data = (%s) errno = %d\n", valread, buffer, errno);
    }

    return NULL;
}

int main(int argc, char const *argv[])
{
    int server_fd;
//    int opt = 1;
    char buffer[1024] = {0};
    char *hello = "Hello from server";
    pthread_t thread_id;
    int nMode = 0; // 0: BLOCKING

    if(argc < 2)
    {
        printf("\nUsage: %s <port>\n", argv[0]);
        printf("Port is the server listining port number\n");
        exit(1);
    }


    // Creating socket file descriptor
    if ((server_fd = socket(AF_INET, SOCK_DGRAM, 0)) == 0)
    {
        perror("socket failed");
        exit(EXIT_FAILURE);
    }

    if (ioctl(server_fd, FIONBIO, &nMode) == -1)
    {
        close(server_fd);
        return  1;
    }
#if 0
    // Forcefully attaching socket to the port 8080
    if (setsockopt(server_fd, SOL_SOCKET, SO_REUSEADDR | SO_REUSEPORT,
                &opt, sizeof(opt)))
    {
        perror("setsockopt");
        exit(EXIT_FAILURE);
    }
#endif


    address.sin_family = AF_INET;
    address.sin_addr.s_addr = INADDR_ANY; //inet_addr("127.0.0.1");;
    address.sin_port = htons( atoi(argv[1]));

    if (bind(server_fd, (struct sockaddr *)&address,
                sizeof(address))<0)
    {
        perror("bind failed");
        exit(EXIT_FAILURE);
    }

    pthread_create(&thread_id, NULL, thread_receiver, (void *)&server_fd);

    while(1) {
        printf("Enter the string to send to Client:");
        scanf("%s",buffer);

        sendto(server_fd, buffer, strlen(buffer) , 0, (struct sockaddr *)&address, sizeof(address));
    }

    return 0;
}

Example UDP Client Program:

// Client side C/C++ program to demonstrate Socket programming
#include <stdio.h>
#include <sys/socket.h>
#include <stdlib.h>
#include <netinet/in.h>
#include <string.h>
// FTP 20 & 21, HTTP = 80,
#define PORT 8000

#include <pthread.h>
#include <errno.h>
void *thread_receiver(void *sock)
{
    int valread = 0;
    char buffer[1024];
    socklen_t addr_size = 0;
    struct sockaddr_in serv_addr;

    addr_size = sizeof(serv_addr);
    while(1) {
        memset(buffer,0, sizeof(buffer));
        if((valread = recvfrom((*(int *)sock), buffer, 1024, 0, (struct sockaddr *)&serv_addr,&addr_size)) < 0 ) {
            perror("Error in receiving : ");
        }
#if 0
        // zero indicates end of file
        if(valread == 0) {
            printf("\n\n The server process is terminated so closing the connection \n");
            exit(0);
        }
#endif

        printf("\nVel Client Received no of byte = (%d) data = (%s) err= %d\n", valread, buffer, errno );

    }

    return NULL;
}

int main(int argc, char const *argv[])
{
    struct sockaddr_in address;
    int sock = 0, valread;
    struct sockaddr_in serv_addr;
    char *hello = "Hello from client";
    char buffer[1024] = {0};
    pthread_t thread_id;


    if(argc < 3)
    {
        printf("\nUsage: %s <dstaddress> <port>\n", argv[0]);
        printf("- dstaddress is the target UDP server IP\n");
         printf("- port is the server listining port number\n");
        exit(1);
    }

    // Creating socket file descriptor
    if ((sock = socket(AF_INET, SOCK_DGRAM, 0)) < 0)
    {
        printf("\n Socket creation error \n");
        return -1;
    }


    printf("Vel argv= %s %s argc= %d  \n", argv[0], argv[1], argc);
    memset(&serv_addr, 0, sizeof(serv_addr));

    serv_addr.sin_family = AF_INET;
    serv_addr.sin_port = htons(atoi(argv[2]));
    serv_addr.sin_addr.s_addr = inet_addr(argv[1]);


    pthread_create(&thread_id, NULL, thread_receiver, (void *)&sock);

    while(1) {
        printf("Enter the string to send to Server:");
        scanf("%s",buffer);
        sendto(sock, buffer, strlen(buffer) , 0, (struct sockaddr *)&serv_addr, sizeof(serv_addr));
    }

    return 0;
}






Client and Server Interaction with TCP

TCP (Transmission Control Protocol)


  1. TCP is a connection-oriented protocol.
  2. The connection is established and maintained until the application programs at each end have finished exchanging messages.
  3. TCP is a transport layer protocol used by applications that require guaranteed delivery.
  4. It is a sliding window protocol that provides handling for both timeouts and retransmissions.
  5. TCP establishes a full duplex virtual connection between two endpoints.
  6. Each endpoint is defined by an IP address and a TCP port number.

Example TCP Server program:

// Server side C/C++ program to demonstrate Socket programming
#include <stdio.h>
#include <sys/socket.h>
#include <stdlib.h>
#include <netinet/in.h>
#include <string.h>
#define PORT 8080

#include <pthread.h>
#include <errno.h>

void *thread_receiver(void *new_socket)
{
    int valread = 0;
    char buffer[1024];

    while(1) {
        memset(buffer,0, sizeof(buffer));
        if((valread = read( (*(int *)new_socket), buffer, 1024)) < 0) {
            perror("Error in receiving : ");
        }

        // zero indicates end of file
        if(valread == 0) {
            printf("\n\n The client process is terminated so closing the connection \n");
            exit(0);
        }

        printf("\nVel Server received no of bytes = (%d) Data = (%s) errno = %d\n", valread, buffer, errno);
    }

    return NULL;
}

int main(int argc, char const *argv[])
{
    int server_fd, new_socket, valread;
    struct sockaddr_in address;
    int opt = 1;
    int addrlen = sizeof(address);
    char buffer[1024] = {0};
    char *hello = "Hello from server";
    pthread_t thread_id;

    if(argc < 2)
    {
        printf("\nUsage: %s <port>\n", argv[0]);
        printf("Port is the server listining port number\n");
        exit(1);
    }

    // Creating socket file descriptor
    if ((server_fd = socket(AF_INET, SOCK_STREAM, 0)) == 0)
    {
        perror("socket failed");
        exit(EXIT_FAILURE);
    }

    // Forcefully attaching socket to the port 8080
    if (setsockopt(server_fd, SOL_SOCKET, SO_REUSEADDR | SO_REUSEPORT,
                &opt, sizeof(opt)))
    {
        perror("setsockopt");
        exit(EXIT_FAILURE);
    }
    address.sin_family = AF_INET;
    address.sin_addr.s_addr = INADDR_ANY;
    address.sin_port = htons( atoi(argv[1]));

    // Forcefully attaching socket to the port 8080
    if (bind(server_fd, (struct sockaddr *)&address,
                sizeof(address))<0)
    {
        perror("bind failed");
        exit(EXIT_FAILURE);
    }
    if (listen(server_fd, 3) < 0)
    {
        perror("listen");
        exit(EXIT_FAILURE);
    }
    printf("Vel: Waiting for Client to connect:\n");
    if ((new_socket = accept(server_fd, (struct sockaddr *)&address,
                    (socklen_t*)&addrlen))<0)
    {
        perror("accept");
        exit(EXIT_FAILURE);
    }
    printf("Vel: Got the request from Client & connected to the client:  \n");

    pthread_create(&thread_id, NULL, thread_receiver, (void *)&new_socket);

    while(1) {
        memset(buffer,0,sizeof(buffer));

        printf("Enter the string to send to Client:");
        scanf("%s",buffer);
        if(send(new_socket , buffer, strlen(buffer) , 0 )<0) {
            perror("Error in sending : \n");
        }
    }

    return 0;
}

Example TCP Client program:

/ Client side C/C++ program to demonstrate Socket programming
#include <stdio.h>
#include <sys/socket.h>
#include <stdlib.h>
#include <netinet/in.h>
#include <string.h>
#define PORT 8080

#include <pthread.h>
#include <errno.h>

void *thread_receiver(void *sock)
{
    int valread = 0;
    char buffer[1024];

    while(1) {
        memset(buffer,0, sizeof(buffer));
        if((valread = read( (*(int *)sock), buffer, 1024)) < 0 ) {
            perror("Error in receiving : ");
        }
        // zero indicates end of file
        if(valread == 0) {
            printf("\n\n The server process is terminated so closing the connection \n");
            exit(0);
        }

        printf("\nVel Client Received no of byte = (%d) data = (%s) err= %d\n", valread, buffer, errno );

    }

    return NULL;
}

int main(int argc, char const *argv[])
{
    struct sockaddr_in address;
    int sock = 0, valread;
    struct sockaddr_in serv_addr;
    char *hello = "Hello from client";
    char buffer[1024] = {0};
    pthread_t thread_id;

    if(argc < 3)
    {
        printf("\nUsage: %s <dstaddress> <port>\n", argv[0]);
        printf("- dstaddress is the target tcp server IP\n");
        printf("- port is the server listining port number\n");
        exit(1);
    }

    // Creating socket file descriptor
    if ((sock = socket(AF_INET, SOCK_STREAM, 0)) < 0)
    {
        printf("\n Socket creation error \n");
        return -1;
    }

    memset(&serv_addr, '0', sizeof(serv_addr));

    serv_addr.sin_family = AF_INET;
    serv_addr.sin_port = htons(atoi(argv[2]));

    // Convert IPv4 and IPv6 addresses from text to binary form
    if(inet_pton(AF_INET, argv[1], &serv_addr.sin_addr)<=0)
    {
        printf("\nInvalid address/ Address not supported \n");
        return -1;
    }

    if (connect(sock, (struct sockaddr *)&serv_addr, sizeof(serv_addr)) < 0)
    {
        printf("\nConnection Failed \n");
        return -1;
    }

    pthread_create(&thread_id, NULL, thread_receiver, (void *)&sock);
    while(1) {
        printf("Enter the string to send to Server:");
        scanf("%s",buffer);
        send(sock, buffer, strlen(buffer) , 0 );
    }

    return 0;
}


What is a socket

What is a socket ?

  1. Sockets allow communication between two different processes on the same or different machines.
  2. It’s talk to other computers using standard Unix file descriptors.
  3. A file descriptor is just an integer associated with an open file and it can be a network connection, a text file, a terminal, or something else.
  4. Used in a client-server application framework.
  5. Most of the application-level protocols like FTP, SMTP, and POP3 make use of sockets to establish connection between client and server and then for exchanging data.


Socket Types:

  1. SOCK_STREAM - Provides sequenced, reliable, two-way, connection-based byte streams.
  2. SOCK_DGRAM   - Supports datagrams (connectionless, unreliable messages of a fixed maximum length).
  3. SOCK_RAW        -  Provides raw network protocol access. These provide users access to the underlying communication protocols, which support socket abstractions
  4. SOCK_SEQPACKET  -