Human Generated Data

Title

Untitled (dance class in ballet costumes, holding wands with stars)
Date

1960
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18776

Human Generated Data

Title

Untitled (dance class in ballet costumes, holding wands with stars)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18776

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 97.9
Human 97.9
Person 97.7
Person 97.1
Person 96.7
Person 89.5
Person 87
People 85
Person 84.1
Person 77.2
Person 74.4
Person 71.9
Person 67.2
Text 65.7
Person 61.8
Person 61.7
Sailor Suit 59.6
Bedroom 58.2
Indoors 58.2
Room 58.2
White Board 57.6

Clarifai
created on 2023-10-22

people 99.9
group 99.8
child 99.4
many 98.8
group together 97.3
education 95.7
adult 95.2
wear 94.4
school 93.9
boy 93.7
five 93.6
several 93.4
son 92.4
woman 90.7
music 89.7
man 89.6
retro 89.5
family 89.2
elementary school 88.1
recreation 86.3

Imagga
created on 2022-02-25

blackboard 21.3
drawing 20.6
sketch 20.1
representation 19
man 16.2
person 15.5
grunge 15.3
business 15.2
people 14.5
money 14.5
happy 13.8
currency 13.5
television 13
male 12.8
clock 12.7
mug shot 12.1
wall clock 11.9
old 11.8
adult 11.8
pattern 11.6
vintage 11.6
art 11.4
office 11.2
cash 11
computer 10.9
bank 10.7
photograph 10.6
iron lung 10.6
bill 10.5
home 10.4
retro 9.8
financial 9.8
design 9.8
education 9.5
graphic 9.5
child 9.4
finance 9.3
dollar 9.3
banking 9.2
house 9.2
businessman 8.8
device 8.7
ancient 8.6
frame 8.5
laptop 8.5
flower 8.5
respirator 8.4
portrait 8.4
savings 8.4
economy 8.3
color 8.3
letter 8.2
one 8.2
group 8.1
close 8
screen 8
work 7.8
desk 7.8
brunette 7.8
chalkboard 7.8
smile 7.8
timepiece 7.7
floral 7.7
envelope 7.6
x-ray film 7.5
film 7.5
technology 7.4
indoor 7.3
student 7.2
paint 7.2
smiling 7.2
paper 7.2
looking 7.2
wealth 7.2
job 7.1
antique 7

Google
created on 2022-02-25

Vertebrate 92
Font 79.8
Vintage clothing 74.2
Art 72.7
Baby 71.3
Picture frame 69.1
Toddler 67.2
Room 67.1
Visual arts 66.2
Stock photography 61.7
Team 57.4
Photo caption 56.7
Child 56.2
History 54.5
Uniform 53.9
Monochrome 53.4
Sitting 50.1

Microsoft
created on 2022-02-25

text 98.7
posing 91.6
person 90.3
indoor 88.4
drawing 85.5
child 84.4
clothing 83.7
group 64.6
old 58.5
human face 50.2
sketch 50.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Female, 100%
Happy 28.6%
Calm 21.3%
Sad 20.1%
Confused 15.3%
Fear 4.9%
Surprised 4.8%
Angry 3%
Disgusted 2.1%

AWS Rekognition

Age 0-6
Gender Female, 100%
Calm 99%
Sad 0.5%
Confused 0.2%
Surprised 0.1%
Happy 0.1%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 2-8
Gender Female, 100%
Calm 92.3%
Sad 5.3%
Surprised 0.9%
Disgusted 0.4%
Confused 0.3%
Happy 0.3%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 1-7
Gender Female, 100%
Calm 84.6%
Surprised 10%
Confused 2.7%
Fear 1%
Sad 0.7%
Happy 0.4%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 0-6
Gender Female, 100%
Calm 99.5%
Sad 0.3%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0%
Happy 0%
Confused 0%

AWS Rekognition

Age 2-8
Gender Female, 100%
Calm 95.8%
Confused 2.1%
Fear 0.5%
Happy 0.5%
Angry 0.4%
Surprised 0.3%
Sad 0.2%
Disgusted 0.2%

AWS Rekognition

Age 4-10
Gender Male, 99.7%
Calm 98.7%
Happy 0.5%
Surprised 0.3%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 2-8
Gender Female, 99.6%
Happy 96.8%
Calm 1.4%
Angry 0.4%
Confused 0.4%
Surprised 0.3%
Fear 0.3%
Sad 0.3%
Disgusted 0.3%

AWS Rekognition

Age 2-8
Gender Female, 100%
Calm 60.7%
Happy 27.9%
Angry 4.2%
Surprised 2%
Confused 1.8%
Sad 1.5%
Disgusted 1.1%
Fear 0.9%

AWS Rekognition

Age 1-7
Gender Female, 98.8%
Calm 51.4%
Angry 19.7%
Sad 17%
Confused 8.3%
Surprised 2.1%
Fear 0.6%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 4-10
Gender Female, 85.2%
Fear 75.6%
Calm 10.1%
Surprised 7.8%
Sad 3.1%
Angry 1.1%
Confused 1.1%
Disgusted 0.9%
Happy 0.4%

AWS Rekognition

Age 2-8
Gender Male, 54.5%
Happy 99%
Calm 0.4%
Sad 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%
Angry 0%
Confused 0%

AWS Rekognition

Age 2-8
Gender Female, 99.4%
Calm 98.2%
Sad 0.9%
Confused 0.4%
Surprised 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 6-14
Gender Female, 96.6%
Calm 92.1%
Happy 2.6%
Confused 1.3%
Sad 1.3%
Angry 0.9%
Disgusted 0.8%
Fear 0.5%
Surprised 0.5%

AWS Rekognition

Age 11-19
Gender Female, 99.8%
Calm 88%
Fear 3.7%
Angry 3.1%
Sad 2.2%
Confused 1.1%
Surprised 1.1%
Happy 0.4%
Disgusted 0.4%

AWS Rekognition

Age 1-7
Gender Female, 99.4%
Sad 81.8%
Calm 16.5%
Angry 1.1%
Confused 0.3%
Fear 0.1%
Surprised 0.1%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 1-7
Gender Male, 98%
Sad 99.5%
Fear 0.3%
Calm 0.2%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%
Surprised 0%

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 97.9%
Person 97.7%
Person 97.1%
Person 96.7%
Person 89.5%
Person 87%
Person 84.1%
Person 77.2%
Person 74.4%
Person 71.9%
Person 67.2%
Person 61.8%
Person 61.7%

Categories

Imagga

pets animals 77.4%
interior objects 15.5%
food drinks 2.3%
people portraits 1.6%
text visuals 1.5%

Text analysis

Amazon

M

Google

10
10