Human Generated Data

Title

Untitled (men in suits)

Date

c. 1966

People

Artist: Robert Burian, American active 1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19254

Human Generated Data

Title

Untitled (men in suits)

People

Artist: Robert Burian, American active 1940s-1950s

Date

c. 1966

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 98.3
Human 98.3
Person 98.1
Suit 94.1
Apparel 94.1
Clothing 94.1
Coat 94.1
Overcoat 94.1
Person 93.2
Person 91.3
Suit 85.7
Person 80.5
Furniture 75.9
Advertisement 71
Poster 71
Person 70.9
Crowd 70.2
Sitting 67.7
People 65
Text 63.3
Suit 62.1
Person 61.6
Tuxedo 59.4
Jury 56.4
Chair 52.5

Imagga
created on 2022-02-25

man 28.2
people 26.8
person 26.1
male 24.1
businessman 22.9
brass 22.9
wind instrument 22.6
black 21.4
business 21.3
musical instrument 21.1
silhouette 20.7
adult 16.9
cornet 16.5
professional 14.7
office 14.6
men 13.7
suit 13
group 12.9
corporate 12
executive 11.5
couple 11.3
portrait 11
fashion 10.6
attractive 10.5
success 10.5
style 10.4
model 10.1
jacket 9.9
team 9.9
human 9.7
job 9.7
stringed instrument 9.7
boy 9.7
boss 9.6
women 9.5
event 9.2
communication 9.2
room 9.2
happy 8.8
love 8.7
lifestyle 8.7
planner 8.6
play 8.6
sport 8.6
modern 8.4
device 8.4
active 8.2
guitar 8.2
teacher 8.1
sexy 8
posing 8
chair 7.8
sitting 7.7
meeting 7.5
fun 7.5
manager 7.4
businesswoman 7.3
board 7.2
dress 7.2
night 7.1
work 7.1
stage 7.1
travel 7
indoors 7
employee 7

Google
created on 2022-02-25

Coat 90.3
Suit 81.7
Font 80.1
Blazer 77.8
Art 75.5
Formal wear 75.1
Event 68.5
Room 67.8
Vintage clothing 65.7
Classic 64.3
Sitting 63.6
Stock photography 62.2
Rectangle 61.8
White-collar worker 60.8
Painting 59.3
Photo caption 56.9
Chair 55.3
Illustration 52.8
Retro style 50.1

Microsoft
created on 2022-02-25

text 99.8
clothing 97.4
wall 97.3
person 95.8
man 93.7
black 67.5
suit 62.8
poster 61
posing 59.7
old 45.8
picture frame 9.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 90.4%
Sad 7.4%
Fear 0.9%
Confused 0.7%
Angry 0.2%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 93.6%
Confused 2.8%
Surprised 1.7%
Sad 0.7%
Fear 0.4%
Angry 0.4%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 53-61
Gender Male, 100%
Calm 60.9%
Fear 21%
Surprised 10.6%
Angry 2.6%
Confused 1.9%
Sad 1.4%
Disgusted 1%
Happy 0.6%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 88.2%
Confused 4.8%
Fear 2.1%
Sad 1.9%
Disgusted 1.4%
Surprised 0.8%
Angry 0.6%
Happy 0.3%

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Calm 96.1%
Confused 1.6%
Surprised 0.6%
Happy 0.4%
Disgusted 0.4%
Sad 0.3%
Angry 0.3%
Fear 0.2%

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Suit 94.1%
Poster 71%
Chair 52.5%

Captions

Microsoft

a group of people posing for a photo 93.3%
a group of people posing for the camera 93.2%
a group of people posing for a picture 93.1%

Text analysis

Amazon

133

Google

33 .... ...... e o.
o.
e
33
....
......