Human Generated Data

Title

Untitled (family, missing child)

Date

1960

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18751

Human Generated Data

Title

Untitled (family, missing child)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18751

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.9
Apparel 99.9
Shorts 99.9
Person 99.5
Human 99.5
Person 99.4
Person 99.3
Chair 98.6
Furniture 98.6
Person 98.6
Person 98.4
Person 98.3
Person 97.9
Person 97.2
Person 97.1
Dress 95.7
Person 95.3
Female 95.2
Person 92
Shoe 90
Footwear 90
Shelter 89.7
Nature 89.7
Countryside 89.7
Rural 89.7
Outdoors 89.7
Building 89.7
Face 86.3
Housing 83.5
People 82.1
Shoe 81.9
Woman 81.1
Skirt 80.9
Smile 79.7
Kid 75.1
Child 75.1
Grass 73.7
Plant 73.7
Girl 73.6
Shoe 71
Person 67.1
Suit 64.6
Coat 64.6
Overcoat 64.6
Couch 61.8
Person 60.5
Photography 60.4
Photo 60.4
House 58.9
Yard 57.4
Porch 55.4
Teen 55.2

Clarifai
created on 2023-10-22

people 100
group 99.5
child 99.3
group together 99
many 98.4
adult 98.1
woman 97.6
man 96.6
several 95.4
recreation 93.7
boy 93.3
wear 92.8
adolescent 92.7
school 92.5
education 91.1
outfit 90.7
five 90.5
music 89.8
family 86.2
drum 83.8

Imagga
created on 2022-03-05

brass 56.3
wind instrument 47.4
musical instrument 32.8
people 29
man 27.5
sport 27.4
silhouette 26.5
trombone 26.3
male 25.5
men 20.6
outdoors 20.1
person 18.9
athlete 17.6
group 16.9
adult 16.6
boy 16.5
couple 15.7
competition 14.6
sax 14.4
baritone 14.3
family 14.2
active 14.2
lifestyle 13.7
child 13.5
sunset 13.5
together 13.1
field 12.5
summer 12.2
player 12.1
fun 12
happy 11.9
exercise 11.8
beach 11.8
happiness 11.7
team 11.6
outdoor 11.5
ball 11.3
sky 10.8
kin 10.6
run 10.6
play 10.3
friendship 10.3
women 10.3
grass 10.3
teenager 10
recreation 9.9
trainer 9.8
black 9.6
training 9.2
fitness 9
father 9
goal 8.6
crowd 8.6
running 8.6
day 8.6
youth 8.5
business 8.5
joy 8.3
life 8.2
children 8.2
success 8
kid 8
businessman 7.9
art 7.9
son 7.6
relax 7.6
kids 7.5
enjoy 7.5
leisure 7.5
teamwork 7.4
vacation 7.4
playing 7.3
runner 7.3
sun 7.2
game 7.1
love 7.1
spectator 7.1

Google
created on 2022-03-05

Vertebrate 91.9
Window 86.3
Style 83.8
Art 76.9
Monochrome 74.9
Building 74.7
Vintage clothing 73.4
Monochrome photography 72.7
Room 67
History 66.6
Sitting 66.1
Event 65.6
Visual arts 64.8
Suit 63.9
Child 62
Chair 60.1
Team 59.6
Font 59
Illustration 58.1
Family 52.3

Microsoft
created on 2022-03-05

person 99
clothing 95.9
outdoor 91.5
footwear 87.9
drawing 86
standing 78.9
text 70
group 68.4
man 66.6
woman 62.4
posing 37.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 99.3%
Happy 60.2%
Calm 28.9%
Sad 4.6%
Surprised 2.7%
Fear 1.3%
Confused 1.1%
Disgusted 0.6%
Angry 0.6%

AWS Rekognition

Age 36-44
Gender Female, 66.8%
Happy 94.4%
Calm 3.1%
Disgusted 1%
Sad 0.9%
Confused 0.2%
Angry 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 84.1%
Sad 6%
Angry 3.8%
Surprised 2.4%
Disgusted 1.7%
Confused 1.1%
Happy 0.6%
Fear 0.3%

AWS Rekognition

Age 24-34
Gender Female, 96.9%
Calm 87.5%
Surprised 10.7%
Sad 1.2%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 80.7%
Calm 92.3%
Surprised 4.2%
Sad 0.9%
Happy 0.7%
Disgusted 0.6%
Angry 0.6%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Female, 91.5%
Calm 81%
Happy 17.2%
Sad 0.8%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 11-19
Gender Female, 58.1%
Calm 89.7%
Sad 6.1%
Happy 1.8%
Surprised 0.7%
Disgusted 0.5%
Fear 0.5%
Confused 0.4%
Angry 0.4%

AWS Rekognition

Age 26-36
Gender Male, 99.7%
Calm 96.4%
Surprised 1.6%
Sad 1%
Happy 0.3%
Confused 0.3%
Disgusted 0.3%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 39.5%
Sad 38.4%
Happy 14.6%
Surprised 1.8%
Confused 1.7%
Disgusted 1.4%
Fear 1.4%
Angry 1.1%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 64.9%
Sad 18.6%
Angry 7.4%
Happy 3.1%
Confused 1.7%
Disgusted 1.7%
Surprised 1.5%
Fear 1%

AWS Rekognition

Age 16-22
Gender Male, 50.8%
Calm 96.3%
Sad 1.7%
Happy 0.6%
Fear 0.4%
Surprised 0.3%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.5%
Person 99.4%
Person 99.3%
Person 98.6%
Person 98.4%
Person 98.3%
Person 97.9%
Person 97.2%
Person 97.1%
Person 95.3%
Person 92%
Person 67.1%
Person 60.5%
Shoe 90%
Shoe 81.9%
Shoe 71%

Text analysis

Amazon

4
4 05213
05213