Human Generated Data

Title

Untitled (portrait of a large family outside a house)
Date

1959
People

Artist: John Deusing, American active 1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1601

Human Generated Data

Title

Untitled (portrait of a large family outside a house)

People

Artist: John Deusing, American active 1940s

Date

1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1601

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.4
Human 99.4
Person 98.4
People 96.4
Person 95.7
Person 94.6
Person 94.5
Person 94.2
Person 93.6
Person 92.6
Person 91.8
Person 91.2
Person 86.5
Person 85.1
Person 84
Person 82.7
Clothing 81.3
Apparel 81.3
Person 81.2
Tie 80.5
Accessories 80.5
Accessory 80.5
Person 78.3
Person 76.2
Family 72.2
Person 71.1
Person 71
Person 70.1
Person 69.9
Military Uniform 69
Military 69
Person 66.2
Soldier 61.8
Face 57
Person 56.4
Army 56.1
Armored 56.1
Person 44.6
Person 44.2

Clarifai
created on 2023-10-25

people 99.9
many 99
group 98.5
child 97.1
adult 96.7
man 94.9
group together 93.7
uniform 93.4
education 91.2
woman 91.1
wear 89.9
boy 89.7
school 85.1
outfit 82.3
family 82.2
adolescent 79.3
sit 77.2
portrait 75.5
several 75
retro 74.6

Imagga
created on 2021-12-14

kin 53.6
people 18.4
building 15.5
man 15
shop 14.7
male 14.2
portrait 13.6
adult 13
dress 12.6
old 12.5
child 12.2
black 12
outdoors 11.9
person 11.9
women 11.8
school 11.6
scene 11.2
men 11.2
happiness 11
traditional 10.8
art 10.7
family 10.7
decoration 10.2
mercantile establishment 10.2
mother 10.1
happy 10
transportation 9.9
fashion 9.8
human 9.7
barbershop 9.5
outside 9.4
smiling 9.4
holiday 9.3
world 9.3
city 9.1
dirty 9
style 8.9
structure 8.7
couple 8.7
room 8.6
travel 8.4
outdoor 8.4
history 8
lifestyle 7.9
business 7.9
love 7.9
train 7.7
bride 7.7
vintage 7.4
symbol 7.4
tradition 7.4
speed 7.3
design 7.3
transport 7.3
girls 7.3
group 7.2
activity 7.2
interior 7.1
summer 7.1

Google
created on 2021-12-14

Building 95.1
Black 89.6
Window 87.5
House 84.3
Art 77.4
Monochrome 76.9
Monochrome photography 74.8
Font 70
Room 69.4
Suit 68.1
History 66.5
Illustration 65
Team 64.7
Vintage clothing 64
Stock photography 62.6
Painting 61.5
Paper product 59.9
Child 56.7
Facade 56
Grass 54.2

Microsoft
created on 2021-12-14

building 99.4
outdoor 94.1
text 92.5
person 92.1
house 86.9
clothing 72.9
old 71.1
group 66
soccer 59.6
people 56.7
posing 56.6
clothes 17

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 28-44
Gender Male, 56.2%
Happy 84.9%
Calm 8.4%
Fear 2%
Angry 1.8%
Sad 1.6%
Surprised 0.8%
Confused 0.4%
Disgusted 0.2%

AWS Rekognition

Age 47-65
Gender Male, 90.1%
Calm 52.5%
Sad 28.3%
Angry 6.5%
Surprised 5.8%
Confused 3.6%
Fear 2.1%
Happy 0.7%
Disgusted 0.4%

AWS Rekognition

Age 50-68
Gender Male, 67.8%
Happy 53.6%
Calm 40.1%
Sad 3%
Confused 1.5%
Surprised 0.7%
Angry 0.4%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 23-35
Gender Female, 78.1%
Calm 83.1%
Confused 8.2%
Sad 3.4%
Surprised 1.8%
Happy 1.7%
Angry 0.9%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 25-39
Gender Female, 95%
Calm 77.9%
Happy 8.8%
Sad 4.4%
Angry 3.3%
Fear 2%
Surprised 1.7%
Confused 1.4%
Disgusted 0.4%

AWS Rekognition

Age 31-47
Gender Male, 57.9%
Calm 78.2%
Sad 10.9%
Angry 5.1%
Happy 2.7%
Confused 1.1%
Surprised 0.8%
Fear 0.7%
Disgusted 0.6%

AWS Rekognition

Age 42-60
Gender Female, 82.4%
Calm 51.7%
Sad 25.5%
Angry 8.8%
Happy 5.8%
Disgusted 3.6%
Fear 2.6%
Confused 1.2%
Surprised 0.9%

AWS Rekognition

Age 22-34
Gender Female, 59.3%
Calm 64.3%
Sad 16.9%
Happy 10.8%
Angry 4.7%
Disgusted 1.5%
Fear 0.9%
Confused 0.6%
Surprised 0.3%

AWS Rekognition

Age 42-60
Gender Female, 78.8%
Sad 35.2%
Calm 27.7%
Happy 21.5%
Fear 6.9%
Angry 4%
Confused 2.4%
Surprised 1.4%
Disgusted 0.9%

AWS Rekognition

Age 22-34
Gender Male, 67.8%
Happy 61.5%
Calm 29.4%
Sad 4.3%
Surprised 1.8%
Confused 1.7%
Angry 0.7%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 42-60
Gender Female, 78.1%
Sad 56.1%
Calm 32.1%
Angry 6.7%
Confused 1.3%
Fear 1.2%
Happy 1.2%
Surprised 0.9%
Disgusted 0.5%

AWS Rekognition

Age 22-34
Gender Female, 84.4%
Calm 76.5%
Happy 13.9%
Angry 4.8%
Sad 2.4%
Surprised 0.9%
Confused 0.8%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 49-67
Gender Male, 93.2%
Calm 96.7%
Happy 1.6%
Sad 1.1%
Angry 0.5%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 41-59
Gender Female, 64.9%
Calm 71.9%
Happy 16%
Sad 4.1%
Confused 3.4%
Surprised 2.1%
Angry 1.4%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 23-35
Gender Female, 80.9%
Calm 56.3%
Sad 29.3%
Happy 7.9%
Confused 4.5%
Angry 0.5%
Fear 0.5%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 24-38
Gender Male, 69.2%
Happy 81.9%
Calm 14.3%
Sad 3.5%
Confused 0.1%
Angry 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 33-49
Gender Male, 80.6%
Calm 34.1%
Happy 32.8%
Angry 24.5%
Sad 4.1%
Surprised 1.5%
Fear 1.3%
Confused 0.9%
Disgusted 0.8%

AWS Rekognition

Age 29-45
Gender Female, 58.6%
Calm 45%
Sad 30.7%
Confused 15.3%
Angry 3.2%
Surprised 2.9%
Happy 2%
Disgusted 0.7%
Fear 0.2%

AWS Rekognition

Age 22-34
Gender Female, 74.4%
Calm 90.4%
Sad 6.2%
Happy 1.4%
Confused 0.9%
Surprised 0.7%
Angry 0.3%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 25-39
Gender Male, 57.7%
Calm 86.5%
Sad 5.4%
Angry 3.6%
Happy 2.6%
Fear 1.3%
Disgusted 0.2%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 24-38
Gender Male, 98.5%
Calm 66.6%
Fear 10.2%
Surprised 8.3%
Angry 6.5%
Sad 3.5%
Happy 2.3%
Confused 1.5%
Disgusted 1.1%

AWS Rekognition

Age 50-68
Gender Female, 63%
Calm 60.5%
Surprised 16.7%
Confused 9.6%
Sad 5.9%
Angry 3%
Happy 2.1%
Disgusted 1.3%
Fear 0.9%

AWS Rekognition

Age 47-65
Gender Female, 53.5%
Calm 80.1%
Surprised 5.7%
Happy 4.1%
Sad 3%
Angry 2.6%
Disgusted 1.7%
Fear 1.4%
Confused 1.3%

AWS Rekognition

Age 52-70
Gender Male, 63.7%
Calm 58.9%
Happy 30.8%
Sad 2.9%
Angry 2.3%
Surprised 2.1%
Fear 1.6%
Confused 0.9%
Disgusted 0.4%

AWS Rekognition

Age 25-39
Gender Male, 64.8%
Calm 67.4%
Surprised 16.1%
Confused 7.6%
Angry 3.2%
Happy 2.1%
Sad 2%
Disgusted 1.1%
Fear 0.5%

AWS Rekognition

Age 31-47
Gender Female, 51.8%
Happy 93.8%
Calm 3.2%
Surprised 1%
Confused 0.7%
Sad 0.5%
Angry 0.4%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 33-49
Gender Male, 89.5%
Calm 80.4%
Sad 5.9%
Happy 5.2%
Angry 3.7%
Disgusted 1.7%
Confused 1.2%
Fear 1%
Surprised 0.9%

AWS Rekognition

Age 32-48
Gender Female, 94%
Calm 74.6%
Happy 15.3%
Sad 9.5%
Angry 0.3%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 49-67
Gender Female, 76.5%
Calm 49.3%
Angry 17.9%
Sad 13.4%
Confused 7.3%
Happy 5.6%
Disgusted 2.4%
Surprised 2.3%
Fear 1.7%

AWS Rekognition

Age 26-40
Gender Female, 69.3%
Calm 55.9%
Sad 21.7%
Happy 17.3%
Angry 2%
Confused 1%
Fear 0.8%
Surprised 0.8%
Disgusted 0.5%

AWS Rekognition

Age 34-50
Gender Female, 95.4%
Happy 45.6%
Fear 23.7%
Calm 18.3%
Surprised 9%
Sad 1.5%
Confused 1.4%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 29-45
Gender Female, 86.7%
Calm 50.2%
Sad 18.7%
Angry 11.8%
Fear 9.9%
Disgusted 3.2%
Surprised 2.4%
Confused 2.1%
Happy 1.7%

AWS Rekognition

Age 51-69
Gender Female, 77.4%
Happy 85.1%
Calm 6.6%
Surprised 3.2%
Fear 1.4%
Confused 1.1%
Sad 1%
Angry 1%
Disgusted 0.6%

AWS Rekognition

Age 33-49
Gender Female, 69.4%
Calm 73.4%
Happy 14.2%
Angry 3.4%
Surprised 2.6%
Sad 2.4%
Disgusted 2.2%
Confused 1.5%
Fear 0.5%

AWS Rekognition

Age 27-43
Gender Female, 59.7%
Calm 47.5%
Sad 29.2%
Happy 11.7%
Angry 4.9%
Fear 4.9%
Confused 0.8%
Surprised 0.7%
Disgusted 0.3%

AWS Rekognition

Age 36-54
Gender Female, 54.7%
Calm 42.7%
Surprised 26.2%
Fear 12%
Confused 8.2%
Happy 3.8%
Disgusted 2.6%
Sad 2.5%
Angry 2.1%

AWS Rekognition

Age 35-51
Gender Female, 62%
Sad 47.6%
Calm 43.9%
Happy 4.6%
Confused 1.6%
Angry 1.5%
Fear 0.4%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 36-54
Gender Male, 55.8%
Calm 72.3%
Happy 9.3%
Angry 8.9%
Sad 4.5%
Confused 1.7%
Surprised 1.2%
Disgusted 1.1%
Fear 1%

AWS Rekognition

Age 51-69
Gender Female, 82%
Calm 35.4%
Sad 33.1%
Happy 13.6%
Confused 8.4%
Angry 5.5%
Surprised 2.8%
Fear 0.8%
Disgusted 0.5%

AWS Rekognition

Age 23-37
Gender Female, 97.4%
Calm 74.1%
Happy 9.2%
Sad 8.9%
Confused 3.4%
Surprised 2.9%
Angry 0.6%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 25-39
Gender Male, 58.8%
Calm 65.4%
Happy 22.4%
Sad 10.3%
Angry 0.6%
Disgusted 0.4%
Confused 0.3%
Fear 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 80.5%

Categories

Imagga

paintings art 88%
streetview architecture 7.8%
beaches seaside 3%

Text analysis

Amazon

571

Google

6716
6716