Human Generated Data

Title

Untitled (men posing with fish in studio, Manchester, New Hampshire)
Date

c. 1937, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.91

Human Generated Data

Title

Untitled (men posing with fish in studio, Manchester, New Hampshire)

People

Artist: Durette Studio, American 20th century

Date

c. 1937, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.91

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.6
Human 99.6
Person 99.6
Person 99.4
Person 99.3
Person 98.5
Poster 81.1
Advertisement 81.1
People 75.6
Door 65.6
Face 65.4
Clothing 57.9
Apparel 57.9
Art 57.5
Overcoat 56.8
Coat 56.8
Suit 55.2

Clarifai
created on 2023-10-15

people 99.9
group 99.5
leader 98.6
adult 94.8
military 90.9
portrait 90.5
group together 90.3
many 90.3
administration 89.9
man 89.7
wear 89.7
monochrome 89.7
war 88.3
woman 87.9
uniform 87.4
child 83.7
family 80.6
art 80.3
snapshot 79.5
outerwear 78.7

Imagga
created on 2021-12-14

television 100
telecommunication system 54.4
broadcasting 38.8
telecommunication 28.2
black 19.8
medium 18.8
web site 15.7
male 15.6
man 15.4
silhouette 14.1
people 13.4
old 13.2
art 13.1
kin 13
person 12.6
vintage 12.4
monitor 12.2
design 11.2
office 11.2
retro 10.6
grunge 10.2
symbol 9.4
business 9.1
window 8.3
frame 8.3
letter 8.2
equipment 7.9
circa 7.9
postmark 7.9
postage 7.9
postal 7.8
blackboard 7.8
envelope 7.8
ancient 7.8
portrait 7.8
stamp 7.7
men 7.7
mail 7.7
dark 7.5
one 7.5
aged 7.2
dirty 7.2
night 7.1
businessman 7.1

Google
created on 2021-12-14

Outerwear 95.2
Picture frame 88.5
Coat 87.6
Military person 86.6
Font 79.9
Non-commissioned officer 78
Crew 73.2
Event 72.6
Official 71.7
Uniform 71.2
Military officer 69.9
Military uniform 69.6
Suit 68
Vintage clothing 66.9
Team 66.4
Visual arts 65
Monochrome 64.6
Stock photography 64.2
Peaked cap 64
Room 63.8

Microsoft
created on 2021-12-14

text 98.4
clothing 98.4
man 95
person 86.8
posing 85.6
standing 84.1
group 79.1
old 74.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-43
Gender Male, 98.8%
Calm 98.9%
Sad 0.4%
Happy 0.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 36-52
Gender Male, 99%
Calm 96.3%
Sad 1.7%
Angry 1.4%
Fear 0.2%
Confused 0.1%
Surprised 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 32-48
Gender Male, 91.5%
Calm 92.9%
Surprised 2.7%
Angry 1.6%
Sad 1.1%
Happy 0.5%
Fear 0.5%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 32-48
Gender Male, 99.4%
Calm 95.9%
Sad 1.5%
Angry 0.9%
Happy 0.6%
Confused 0.6%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Male, 97.6%
Calm 99.7%
Sad 0.1%
Surprised 0.1%
Angry 0%
Happy 0%
Fear 0%
Disgusted 0%
Confused 0%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Poster 81.1%

Categories

Imagga

paintings art 72.8%
people portraits 18.8%
text visuals 5.7%
food drinks 1.6%

Text analysis

Amazon

25%
E
PHOTO
PHOTO E 25% 055-85
055-85

Google

FHOTD E 25%
FHOTD
E
25%