Human Generated Data

Title

Untitled (man showing stomach and lifting shirt)

Date

1956

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18999

Human Generated Data

Title

Untitled (man showing stomach and lifting shirt)

People

Artist: Bachrach Studios, founded 1868

Date

1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 98.8
Person 98.8
Apparel 97.9
Shoe 97.9
Clothing 97.9
Footwear 97.9
Person 97.6
Overcoat 93.9
Suit 93.9
Coat 93.9
Person 85.5
Face 74
Guitar 73.4
Musical Instrument 73.4
Leisure Activities 73.4
People 62
Photo 60.2
Photography 60.2
Furniture 59.1
Shoe 58.9
Shoe 58.7
Tuxedo 58.1
Shoe 56.8
Accessories 56.2
Tie 56.2
Accessory 56.2
Man 55.3

Imagga
created on 2022-03-05

brass 90.1
cornet 83
wind instrument 74.2
musical instrument 50.7
man 36.9
person 29.1
male 29.1
adult 23.4
people 22.9
senior 19.7
musician 19
businessman 16.8
device 16.4
business 16.4
professional 16.2
portrait 16.2
singer 16.1
hand 15.9
horn 15.8
black 15.6
suit 15.4
handsome 14.3
performer 14
trombone 13.5
stage 13.3
men 12.9
couple 12.2
human 12
expression 11.9
style 11.9
corporate 11.2
mature 11.1
old 11.1
hair 11.1
work 11
happy 10.6
looking 10.4
music 10.1
sax 10
fashion 9.8
love 9.5
lifestyle 9.4
smile 9.3
dark 9.2
group 8.9
instrumentality 8.8
office 8.8
medical 8.8
standing 8.7
face 8.5
casual 8.5
manager 8.4
glasses 8.3
clothing 8.3
holding 8.2
one 8.2
playing 8.2
technology 8.2
body 8
job 8
happiness 7.8
hands 7.8
older 7.8
executive 7.7
jacket 7.7
married 7.7
elderly 7.7
elegance 7.6
shirt 7.5
occupation 7.3
alone 7.3
dress 7.2
gray 7.2
entertainer 7.2
to 7.1
active 7
indoors 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 99.5
clothing 97
man 88.5
person 87.8
black and white 86.1
standing 80.1
concert 56.5
posing 51.1

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 99.4%
Happy 40.4%
Confused 20.2%
Surprised 17.7%
Sad 10.2%
Disgusted 4.4%
Angry 3.2%
Fear 3%
Calm 1%

AWS Rekognition

Age 53-61
Gender Male, 95.5%
Sad 92.8%
Happy 2.2%
Surprised 1.1%
Calm 0.9%
Confused 0.8%
Fear 0.8%
Angry 0.7%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Shoe 97.9%
Suit 93.9%
Guitar 73.4%
Tie 56.2%

Captions

Microsoft

a group of men posing for a photo 74.7%
a group of people posing for a photo 73.8%
a group of people posing for the camera 73.7%

Text analysis

Amazon

2
EO
8
29
C 8 8 2 EO
C
MJI7--YT37A°--

Google

MJI7--YT37A°2 -- XAGO
MJI7--YT37A°2
XAGO
--