Human Generated Data

Title

Untitled (fraternity and sorority party with mud wrestling)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14788

Human Generated Data

Title

Untitled (fraternity and sorority party with mud wrestling)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.3
Person 99.3
Person 98.9
Person 98.4
Person 98.2
Person 98.1
Person 98
Person 97.3
Person 93.5
Text 91.8
Person 91.8
Person 91.5
Person 91.3
Person 83.1
Person 78.8
Poster 75.3
Advertisement 75.3
People 70.9
Person 68.4
Newspaper 67.4
Person 66.5
Archaeology 63.4
Person 63
Person 62.9
Person 61.3
Art 60.6
Drawing 58.9
Person 44.2

Imagga
created on 2022-01-29

newspaper 64.5
product 50.1
creation 39
book jacket 34.2
jacket 26.6
vintage 22.3
wrapping 20.2
man 18.8
daily 18.8
people 17.8
old 17.4
water 15.3
black 15
postmark 14.8
covering 14.6
stamp 14.5
mail 14.4
beach 14.3
retro 13.9
letter 13.8
envelope 13
postage 12.8
outdoors 12.8
male 12.8
postal 12.8
portrait 12.3
summer 12.2
art 11.8
sport 11.8
person 11.4
couple 11.3
one 11.2
sea 10.9
relaxation 10.9
aged 10.9
circa 10.9
grunge 10.2
happy 10
adult 9.9
printed 9.8
vacation 9.8
sexy 9.6
post 9.5
fine 9.5
ancient 9.5
bikini 9.1
shows 8.9
body 8.8
cutting 8.7
paper 8.6
two 8.5
global 8.2
landscape 8.2
office 8
masterpiece 7.9
philately 7.9
business 7.9
known 7.9
holiday 7.9
day 7.8
child 7.8
paintings 7.8
face 7.8
antique 7.8
culture 7.7
pool 7.7
communications 7.7
money 7.7
card 7.7
texture 7.6
painted 7.6
unique 7.6
hobby 7.6
relax 7.6
ocean 7.6
power 7.6
frame 7.5
symbol 7.4
light 7.4
sun 7.2
paint 7.2
lifestyle 7.2
sand 7.2
painter 7.1
happiness 7
travel 7

Google
created on 2022-01-29

Organism 85.2
Art 80.1
Font 76.6
Vintage clothing 69.7
Monochrome 68
Visual arts 67.2
Paper product 66.6
History 66.2
Monochrome photography 65.1
Illustration 63.8
Stock photography 63
Room 60.9
Working animal 60
Tree 59.8
Painting 59.3
Photographic paper 59.2
Printmaking 56.5

Microsoft
created on 2022-01-29

text 99.4
grave 81.6
black 78.8
person 70.8
cemetery 70.7
old 65.2
white 64.9
drawing 56.3
vintage 31.8
picture frame 7.5

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 53.1%
Calm 49%
Fear 19.2%
Happy 13.7%
Disgusted 6.5%
Sad 4.7%
Angry 3.9%
Confused 1.7%
Surprised 1.2%

AWS Rekognition

Age 21-29
Gender Male, 99.4%
Calm 92.2%
Sad 2.4%
Fear 1.9%
Happy 1.3%
Surprised 1.1%
Confused 0.6%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 21-29
Gender Male, 88.1%
Calm 92.6%
Happy 4.6%
Confused 1.8%
Angry 0.4%
Fear 0.2%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%

AWS Rekognition

Age 25-35
Gender Female, 91%
Happy 46.8%
Calm 33.5%
Confused 6.3%
Disgusted 3.8%
Sad 3.2%
Angry 2.6%
Fear 2.2%
Surprised 1.6%

AWS Rekognition

Age 16-24
Gender Female, 78.1%
Calm 84.4%
Confused 8.5%
Sad 2.1%
Disgusted 1.4%
Surprised 1.2%
Happy 1.1%
Angry 0.8%
Fear 0.6%

AWS Rekognition

Age 30-40
Gender Male, 78%
Calm 91.9%
Sad 2.5%
Fear 2%
Happy 1.1%
Confused 0.8%
Disgusted 0.7%
Surprised 0.7%
Angry 0.3%

AWS Rekognition

Age 38-46
Gender Female, 97.6%
Calm 65.7%
Happy 12.1%
Angry 7%
Fear 5.1%
Sad 3.5%
Disgusted 2.9%
Confused 2.2%
Surprised 1.6%

AWS Rekognition

Age 20-28
Gender Female, 96.5%
Calm 46.7%
Happy 41.3%
Confused 6.9%
Sad 1.6%
Surprised 1%
Angry 1%
Disgusted 0.9%
Fear 0.7%

AWS Rekognition

Age 22-30
Gender Male, 93.5%
Happy 94.1%
Calm 4.4%
Surprised 0.4%
Fear 0.3%
Sad 0.3%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 50-58
Gender Male, 90.7%
Happy 30.5%
Calm 22.9%
Confused 20.6%
Sad 16.8%
Angry 4.2%
Disgusted 2.8%
Surprised 1.4%
Fear 0.8%

AWS Rekognition

Age 42-50
Gender Male, 99.4%
Happy 40.7%
Calm 28.6%
Sad 22.3%
Confused 2.8%
Angry 2.2%
Disgusted 1.6%
Surprised 1%
Fear 0.8%

AWS Rekognition

Age 21-29
Gender Male, 99.5%
Calm 96.8%
Confused 0.8%
Disgusted 0.5%
Sad 0.5%
Happy 0.5%
Surprised 0.4%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 29-39
Gender Male, 78.8%
Happy 71.1%
Calm 15.9%
Sad 4%
Fear 2.9%
Confused 2.2%
Surprised 2.1%
Disgusted 1.1%
Angry 0.8%

AWS Rekognition

Age 26-36
Gender Female, 99.2%
Happy 95.3%
Calm 2.6%
Sad 1.4%
Fear 0.2%
Confused 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Male, 93.2%
Happy 62.9%
Sad 28%
Disgusted 3.2%
Calm 2.3%
Fear 1.1%
Angry 1%
Surprised 0.8%
Confused 0.6%

AWS Rekognition

Age 22-30
Gender Male, 99.3%
Calm 80.4%
Happy 14.7%
Surprised 1.6%
Disgusted 1.1%
Fear 0.7%
Sad 0.7%
Angry 0.6%
Confused 0.3%

AWS Rekognition

Age 27-37
Gender Male, 96.7%
Happy 56.6%
Calm 22.4%
Sad 10%
Fear 4.6%
Disgusted 2.4%
Confused 2.1%
Angry 1%
Surprised 1%

AWS Rekognition

Age 27-37
Gender Female, 70.7%
Sad 93.6%
Calm 3.6%
Confused 1.6%
Happy 0.6%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Poster 75.3%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 76.3%
a vintage photo of a group of people posing for a picture 76.2%
a vintage photo of a person 76.1%

Text analysis

Amazon

4
KODAK
FILM
KODAK SAFETY FILM
SAFETY
с
FA

Google

KODAK
KODAK SAFETY FILM KODAK
FILM
SAFETY