Human Generated Data

Title

Untitled (old couple standing between nine standing guests at anniversary party)
Date

1949
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9240

Human Generated Data

Title

Untitled (old couple standing between nine standing guests at anniversary party)

People

Artist: Martin Schweig, American 20th century

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.3
Human 99.3
Person 99.3
Person 99.3
Clothing 99.1
Apparel 99.1
Person 98.9
Person 98.6
Person 98.6
Person 98
Person 95.4
Collage 94.9
Advertisement 94.9
Poster 94.9
Person 94.4
Dress 91
Tie 88.2
Accessories 88.2
Accessory 88.2
Person 84.6
Female 84.5
Person 83.1
People 82.5
Face 78.7
Suit 77.5
Coat 77.5
Overcoat 77.5
Text 77.4
Sleeve 72.4
Tie 70.4
Girl 67.6
Kid 64.9
Child 64.9
Shorts 64.4
Photography 64
Photo 64
Fashion 62.8
Woman 61.5
Paper 61.4
Shirt 58.6
Flyer 57.3
Brochure 57.3
Gown 57.2
Robe 55.9

Imagga
created on 2022-01-23

people 32.3
person 28.3
negative 25.9
film 22.4
man 20.9
men 20.6
adult 20.5
crowd 20.1
group 19.3
male 17.7
women 17.4
business 17
golfer 16.7
photographic paper 15.8
player 15.7
businessman 15
couple 14.8
wineglass 14.3
portrait 13.6
team 13.4
silhouette 13.2
happy 12.5
fashion 12
life 12
human 12
professional 11.8
businesswoman 11.8
clothing 11.7
brass 11.6
family 10.7
job 10.6
photographic equipment 10.6
walking 10.4
contestant 10.4
party 10.3
motion 10.3
speed 10.1
outdoors 9.7
work 9.4
lifestyle 9.4
sport 9.2
wind instrument 9.2
fun 9
glass 8.9
looking 8.8
together 8.8
smiling 8.7
water 8.7
happiness 8.6
winter 8.5
friendship 8.4
world 8.4
teamwork 8.3
dress 8.1
activity 8.1
success 8
standing 7.8
scene 7.8
color 7.8
model 7.8
old 7.7
worker 7.7
elegance 7.5
joy 7.5
friends 7.5
symbol 7.4
light 7.3
occupation 7.3
active 7.3
suit 7.2
body 7.2
celebration 7.2
holiday 7.2
drawing 7.1
love 7.1

Google
created on 2022-01-23

Fashion 87.9
Sleeve 87.2
Organism 85.4
Art 83.6
Font 83
Pattern 75.3
Snapshot 74.3
Event 72.3
Rectangle 72.1
Painting 71.9
Illustration 71.9
Fashion design 70.6
Visual arts 69.7
Room 67.5
Monochrome 65.3
History 64.4
Drawing 63.1
Monochrome photography 57
Vintage clothing 56.9
Overcoat 55.2

Microsoft
created on 2022-01-23

text 96.9
clothing 94.6
person 93.2
woman 83.4
posing 81.4
dress 79.5
wedding dress 74.9
group 74.3
man 57.3
bride 55.5
wedding 50.2

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 91.7%
Happy 91.5%
Sad 4%
Surprised 1.7%
Confused 1.1%
Calm 0.8%
Fear 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 50-58
Gender Male, 79.1%
Sad 90.3%
Confused 2.7%
Calm 2.3%
Happy 1.3%
Surprised 1.1%
Disgusted 1%
Fear 0.8%
Angry 0.4%

AWS Rekognition

Age 31-41
Gender Female, 66.5%
Sad 60.5%
Surprised 14.6%
Happy 10.8%
Calm 5.2%
Disgusted 3.8%
Angry 2%
Fear 1.6%
Confused 1.4%

AWS Rekognition

Age 45-51
Gender Female, 91.7%
Happy 85.2%
Sad 8.3%
Calm 5.2%
Confused 0.4%
Angry 0.3%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Sad 57.5%
Angry 13.1%
Happy 8.3%
Surprised 7.5%
Calm 6.3%
Disgusted 3.9%
Confused 2.3%
Fear 1.1%

AWS Rekognition

Age 36-44
Gender Male, 99.6%
Happy 47.6%
Sad 19.2%
Surprised 13.8%
Calm 8.2%
Disgusted 4.8%
Confused 2.9%
Fear 1.8%
Angry 1.7%

AWS Rekognition

Age 50-58
Gender Female, 55.5%
Happy 52.4%
Sad 34.8%
Surprised 7.3%
Confused 1.8%
Fear 1.1%
Angry 0.9%
Calm 0.9%
Disgusted 0.7%

AWS Rekognition

Age 42-50
Gender Male, 98%
Happy 44.3%
Sad 24.4%
Calm 13.5%
Confused 9.6%
Surprised 3.2%
Disgusted 3.1%
Fear 1%
Angry 1%

AWS Rekognition

Age 49-57
Gender Male, 97.9%
Happy 51.1%
Calm 39.5%
Sad 5.7%
Confused 1.2%
Surprised 1%
Angry 0.7%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 50-58
Gender Male, 98.1%
Happy 57%
Sad 23.8%
Calm 10.7%
Confused 5.4%
Surprised 1.1%
Angry 0.9%
Disgusted 0.7%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 88.2%

Captions

Microsoft

a group of people posing for a photo 91.8%
a group of people posing for a picture 91.7%
a group of people posing for the camera 91.6%

Text analysis

Amazon

43252