Human Generated Data

Title

Untitled (elderly couple posed with children and grandchildren in living room)
Date

1961
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9849

Human Generated Data

Title

Untitled (elderly couple posed with children and grandchildren in living room)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9849

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Clothing 99.5
Apparel 99.5
Person 99.4
Human 99.4
Person 99.2
Person 98.8
Person 98.6
Person 97.9
Person 96.8
Dress 95.6
Person 94.7
Person 94.6
Face 94.5
Person 93.2
Furniture 92.3
Suit 92.1
Overcoat 92.1
Coat 92.1
Tie 91.6
Accessories 91.6
Accessory 91.6
Indoors 90.3
Interior Design 90.1
Person 88
Shorts 86.7
Female 86.1
Person 84.3
Room 82.4
People 82
Chair 82
Kid 73.6
Child 73.6
Tuxedo 68.4
Photography 68.2
Photo 68.2
Portrait 68.1
Floor 67.3
Table 67
Woman 66.9
Cabinet 66.4
Dining Table 66.3
Tie 66.1
Girl 64.6
Person 62.4
Tie 61
Tie 60.7
Head 59.7
Man 55.8
Baby 55.3

Clarifai
created on 2023-10-27

people 99.9
group 99.6
adult 97.7
woman 97.5
man 97.4
group together 96.7
child 96.2
many 92.6
actor 91.8
monochrome 91.6
education 91.5
leader 89.1
family 87
several 85.5
uniform 85.3
three 82.6
wear 82.6
adolescent 80.1
administration 76.3
four 76.2

Imagga
created on 2022-01-28

brass 70.3
wind instrument 53.8
cornet 38.4
musical instrument 36.1
people 29
man 25.5
person 25.1
male 21.3
sport 20.7
adult 18.3
bugle 17.9
active 17.2
men 17.2
exercise 16.3
nurse 15.7
black 15.6
fun 15
headdress 14.3
couple 13.1
bathing cap 12.8
happy 12.5
player 12.5
portrait 12.3
lifestyle 12.3
outdoors 11.9
athlete 11.9
clothing 11.8
professional 11.7
leisure 11.6
play 11.2
happiness 11
business 10.9
football helmet 10.8
businessman 10.6
boy 10.4
health 10.4
body 10.4
competition 10.1
cap 10
outdoor 9.9
fitness 9.9
silhouette 9.9
trombone 9.9
human 9.7
group 9.7
summer 9.6
women 9.5
helmet 9.4
field 9.2
suit 9
game 8.9
standing 8.7
smiling 8.7
love 8.7
crowd 8.6
smile 8.5
fashion 8.3
ball 8.3
guy 8.3
device 8.1
life 8.1
activity 8.1
family 8
art 7.9
together 7.9
face 7.8
party 7.7
run 7.7
motion 7.7
outside 7.7
youth 7.7
baritone 7.4
action 7.4
style 7.4
sports 7.4
playing 7.3
celebration 7.2
recreation 7.2
grass 7.1
sky 7

Google
created on 2022-01-28

Black-and-white 85.5
Style 83.9
Shelf 77.7
Monochrome 76.7
Monochrome photography 74.5
Snapshot 74.3
Art 72.4
Event 71.7
Font 70.3
Vintage clothing 70.1
Room 69.9
Child 69.6
Team 64.8
History 60.5
Suit 59.3
Shelving 58.4
Class 57.9
Visual arts 55.8
Advertising 54.8
Machine 54.7

Microsoft
created on 2022-01-28

text 98.2
person 97.5
posing 94.8
dress 87.9
wedding dress 86.4
clothing 86.2
woman 79.7
standing 78
smile 73.5
bride 73.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Happy 99.6%
Sad 0.2%
Surprised 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%
Calm 0%

AWS Rekognition

Age 34-42
Gender Male, 98.5%
Happy 41.7%
Sad 25.5%
Calm 22.3%
Surprised 5.5%
Angry 2.2%
Confused 1.7%
Disgusted 0.7%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Female, 70.3%
Surprised 78.3%
Calm 9.5%
Sad 3.7%
Happy 3.5%
Fear 2.2%
Confused 1.7%
Disgusted 0.8%
Angry 0.4%

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Calm 79.5%
Sad 9.6%
Happy 6.1%
Disgusted 1.8%
Confused 1.6%
Surprised 0.6%
Angry 0.5%
Fear 0.2%

AWS Rekognition

Age 26-36
Gender Male, 98.2%
Happy 50.2%
Calm 43.7%
Sad 2.4%
Surprised 1.9%
Disgusted 0.7%
Confused 0.7%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Male, 99%
Calm 98.3%
Confused 0.5%
Sad 0.4%
Happy 0.3%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 50-58
Gender Female, 98%
Happy 90.9%
Calm 3.3%
Sad 1.3%
Surprised 1.3%
Disgusted 1.3%
Angry 0.8%
Confused 0.7%
Fear 0.4%

AWS Rekognition

Age 45-51
Gender Male, 99.5%
Sad 77.7%
Calm 14.6%
Happy 2.3%
Surprised 2.3%
Confused 1.1%
Disgusted 1%
Angry 0.6%
Fear 0.5%

AWS Rekognition

Age 35-43
Gender Male, 79%
Calm 98.6%
Sad 0.9%
Surprised 0.2%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 99%
Sad 81.8%
Calm 15.9%
Happy 0.6%
Confused 0.4%
Fear 0.4%
Angry 0.4%
Surprised 0.3%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 99.4%
Person 99.2%
Person 98.8%
Person 98.6%
Person 97.9%
Person 96.8%
Person 94.7%
Person 94.6%
Person 93.2%
Person 88%
Person 84.3%
Person 62.4%
Tie 91.6%
Tie 66.1%
Tie 61%
Tie 60.7%

Text analysis

Amazon

POHSO
KRODAK-AITW

Google

22150
22150