Human Generated Data

Title

Untitled (men standing at microphone, one with toilet seat)

Date

1947

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21721

Human Generated Data

Title

Untitled (men standing at microphone, one with toilet seat)

People

Artist: John Howell, American active 1930s-1960s

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 99.6
Human 99.6
Person 99.6
Person 98.2
Person 96.6
Face 79.2
Clothing 78.6
Apparel 78.6
Portrait 65.9
Photography 65.9
Photo 65.9
Accessories 65.8
Sunglasses 65.8
Accessory 65.8
Finger 63.5
Suit 63
Overcoat 63
Coat 63
Electronics 61.6
Studio 59.8
Leisure Activities 57.6
Sleeve 56.9

Imagga
created on 2022-03-11

man 43
male 39.7
people 34
person 27.5
adult 26.5
business 24.9
men 21.4
businessman 21.2
trombone 19.7
portrait 19.4
office 19.1
happy 18.8
brass 18.8
face 17.7
corporate 17.2
work 16.5
casual 16.1
lifestyle 15.9
professional 15.6
smiling 14.5
wind instrument 14.4
businesspeople 14.2
job 14.1
musical instrument 13.6
looking 13.6
handsome 13.4
worker 13.2
mature 13
phone 12.9
room 12.7
employee 12.7
career 12.3
desk 12.3
sitting 12
computer 12
suit 11.8
working 11.5
barroom 11.4
indoors 11.4
black 11.4
cheerful 11.4
senior 11.2
occupation 11
happiness 11
laptop 10.9
conversation 10.7
talking 10.4
couple 10.4
old 10.4
executive 10.3
businesswoman 10
smile 10
building 9.9
hand 9.9
attractive 9.8
expression 9.4
communication 9.2
modern 9.1
device 9
life 8.9
clothing 8.9
success 8.8
home 8.8
women 8.7
hands 8.7
serious 8.6
meeting 8.5
indoor 8.2
one 8.2
outdoors 8.2
confident 8.2
jacket 8
love 7.9
together 7.9
discussion 7.8
30s 7.7
elderly 7.7
student 7.5
leisure 7.5
company 7.4
inside 7.4
successful 7.3
group 7.2
color 7.2
medical 7.1
day 7.1

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

text 99.1
person 97.9
clothing 96.2
man 93.1
musical instrument 91.9
standing 89.9
outdoor 88.7
microphone 87.9
concert 74.4
human face 52.5
posing 52.2
guitar 50.7

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 87.2%
Happy 78.9%
Angry 6.9%
Surprised 4.8%
Calm 4.6%
Confused 1.9%
Disgusted 1.3%
Fear 1.1%
Sad 0.7%

AWS Rekognition

Age 37-45
Gender Male, 99.4%
Surprised 95.1%
Happy 3.8%
Calm 0.6%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Calm 97%
Happy 1.9%
Confused 0.5%
Disgusted 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Sunglasses 65.8%

Captions

Microsoft

a person standing in front of a group of people posing for the camera 73.2%
a person standing in front of a group of people posing for a photo 69.6%
a person standing in front of a group of people posing for a picture 69.5%

Text analysis

Amazon

6