Human Generated Data

Title

Untitled (girls and one boy in dance costumes, boy wearing striped suit jacket)

Date

1960

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18785

Human Generated Data

Title

Untitled (girls and one boy in dance costumes, boy wearing striped suit jacket)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18785

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 99.5
Human 99.5
Person 98.9
Person 98.5
Person 98
Person 97.9
Person 97.7
Person 97.3
Person 95.2
Person 93.7
School 91.9
Clothing 91.1
Apparel 91.1
Classroom 90.6
Room 90.6
Indoors 90.6
Airplane 88.5
Transportation 88.5
Vehicle 88.5
Aircraft 88.5
Kindergarten 87.1
Shoe 83.1
Footwear 83.1
Shoe 73.5
Girl 68.6
Female 68.6
Shoe 68
People 67.2
Screen 62.5
Electronics 62.5
Shoe 52.2

Clarifai
created on 2023-10-22

people 99.9
wear 99.5
group together 98.9
uniform 98.8
group 98.4
many 96.9
child 95.7
outfit 94.7
adult 93.8
military 91.9
school 91.4
man 91
five 90.7
education 89.7
several 89.6
retro 88.3
portrait 87.7
baseball 87.5
boy 86.1
woman 85.4

Imagga
created on 2022-02-25

brass 42.3
people 35.7
wind instrument 34.4
person 34.1
musical instrument 31.4
classroom 29.3
male 29.1
group 29
room 27.1
man 26.9
men 25.7
adult 25.3
teacher 23.6
women 21.3
happy 20.7
team 19.7
professional 19.7
nurse 18
lifestyle 17.3
together 16.6
businessman 15.9
indoors 14
couple 13.9
smiling 13.7
fun 13.5
business 13.3
family 13.3
happiness 13.3
boy 13
portrait 12.3
educator 12.3
trombone 12.2
student 12
sitting 12
home 12
casual 11.8
cheerful 11.4
sport 11.3
teamwork 11.1
youth 11.1
girls 10.9
child 10.9
attractive 10.5
education 10.4
violin 10.1
children 10
holding 9.9
worker 9.8
party 9.4
friends 9.4
school 9.4
friendship 9.4
smile 9.3
joy 9.2
silhouette 9.1
kid 8.9
job 8.8
students 8.8
table 8.6
work 8.6
chair 8.5
executive 8.3
human 8.2
businesswoman 8.2
board 8.1
stringed instrument 8.1
recreation 8.1
dancer 8.1
black 7.8
bowed stringed instrument 7.7
class 7.7
diversity 7.7
crowd 7.7
meeting 7.5
study 7.5
teenager 7.3
color 7.2
clothing 7.2
suit 7.2
body 7.2
celebration 7.2
love 7.1
to 7.1
interior 7.1

Google
created on 2022-02-25

Art 81.3
Vintage clothing 73.1
Event 71.9
Aircraft 70.6
Fashion design 66.7
Illustration 66.6
Drawing 66.2
Room 64.9
Visual arts 63.1
Stock photography 62.2
Painting 61.4
Monochrome 60.6
History 59
Uniform 58.1
Font 55.3
Sketch 55.3
Photo caption 54.9
Advertising 54.4
Retro style 54.3
Team 53.8

Microsoft
created on 2022-02-25

posing 98.8
wall 98
old 96.6
person 94.1
indoor 88.5
group 86
standing 84.5
text 83
clothing 80.5
black 77.9
white 70.6
vintage 40.4
team 33.5
female 29
clothes 24.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 100%
Happy 81.7%
Confused 5.9%
Sad 3.7%
Fear 2.4%
Surprised 2.2%
Calm 1.8%
Disgusted 1.5%
Angry 1%

AWS Rekognition

Age 2-10
Gender Male, 83.1%
Happy 91.5%
Calm 6.8%
Surprised 1%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 6-12
Gender Female, 97.5%
Happy 99%
Fear 0.2%
Angry 0.2%
Confused 0.2%
Surprised 0.1%
Sad 0.1%
Calm 0.1%
Disgusted 0.1%

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 93%
Calm 4.8%
Confused 0.6%
Angry 0.5%
Surprised 0.4%
Sad 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 6-14
Gender Female, 100%
Angry 23.5%
Happy 21.8%
Calm 19.8%
Surprised 9.4%
Confused 9.3%
Sad 6%
Disgusted 5.3%
Fear 5%

AWS Rekognition

Age 6-14
Gender Female, 88.5%
Happy 99.9%
Calm 0%
Confused 0%
Surprised 0%
Angry 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 6-16
Gender Female, 99.1%
Happy 80%
Calm 16.8%
Confused 1.3%
Sad 0.6%
Surprised 0.4%
Fear 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 2-8
Gender Female, 99.9%
Happy 99.4%
Surprised 0.2%
Calm 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 1-7
Gender Female, 99.6%
Happy 99.8%
Surprised 0.1%
Confused 0.1%
Angry 0%
Sad 0%
Calm 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Airplane
Shoe
Person 99.5%
Person 98.9%
Person 98.5%
Person 98%
Person 97.9%
Person 97.7%
Person 97.3%
Person 95.2%
Person 93.7%
Airplane 88.5%
Shoe 83.1%
Shoe 73.5%
Shoe 68%
Shoe 52.2%

Categories