Human Generated Data

Title

Untitled (men in striped suits with musical instruments)

Date

1928

People

Artist: Hamblin Studio, American active 1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2002

Human Generated Data

Title

Untitled (men in striped suits with musical instruments)

People

Artist: Hamblin Studio, American active 1930s

Date

1928

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Furniture 99.2
Chair 99.2
Human 99.2
Person 99.2
Person 99.1
Chair 99
Indoors 98.2
Room 98.2
Chair 98.1
Person 96.9
Person 93.5
Person 93.3
Person 90.5
Person 83
Dressing Room 82.9
People 81.8
Person 67.4
Person 66.3
Musical Instrument 55.9
Living Room 55.2

Imagga
created on 2021-12-14

white goods 100
dishwasher 100
home appliance 97.1
appliance 72.2
durables 32
interior 23
glass 22.8
modern 19.6
kitchen 18.8
home 15.9
equipment 15.9
house 15.9
technology 14.1
light 12.7
clean 12.5
design 12.4
medical 12.4
architecture 11.7
case 11.7
stainless 11.6
decor 11.5
water 11.3
furniture 10.6
laboratory 10.6
steel 10.6
digital 10.5
research 10.5
table 10.4
business 10.3
luxury 10.3
decoration 10.1
oven 9.8
science 9.8
experiment 9.7
food 9.7
chemistry 9.7
cooking 9.6
liquid 9.6
biology 9.5
window 9.3
3d 9.3
indoor 9.1
medicine 8.8
lab 8.7
chemical 8.7
room 7.9
cabinet 7.9
stove 7.9
glassware 7.8
elegant 7.7
estate 7.6
real 7.6
floor 7.4
symbol 7.4
building 7.3
new 7.3
computer 7.2
wealth 7.2
celebration 7.2
restaurant 7.2
indoors 7

Google
created on 2021-12-14

Drum 86.9
Chair 83.2
Art 77.3
Monochrome 74.1
Font 73.6
Painting 73.4
Monochrome photography 72.6
Event 71.8
Room 65.9
Picture frame 63.8
Illustration 63.2
Suit 62.3
History 61.2
Photo caption 60.9
Musical instrument 60.6
Team 58.8
Classic 57.5
Vintage clothing 56.8
Circle 56.7
Rectangle 55.4

Microsoft
created on 2021-12-14

text 98.5
old 62.1

Face analysis

Amazon

Google

AWS Rekognition

Age 50-68
Gender Male, 73%
Calm 55.8%
Sad 42.1%
Surprised 0.7%
Confused 0.6%
Angry 0.6%
Happy 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Male, 75.4%
Calm 78.3%
Sad 13.2%
Happy 4.1%
Confused 1.5%
Angry 1.2%
Disgusted 0.8%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 45-63
Gender Male, 96.6%
Calm 89.5%
Happy 7.2%
Surprised 1.8%
Sad 0.5%
Confused 0.4%
Angry 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 13-23
Gender Female, 90.9%
Happy 81.6%
Calm 17.5%
Sad 0.7%
Angry 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 47-65
Gender Male, 91.2%
Calm 71.6%
Sad 27.6%
Happy 0.5%
Confused 0.1%
Angry 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Chair 99.2%
Person 99.2%

Captions

Microsoft

a group of people standing next to a window 55.3%
a group of people posing for a photo in front of a window 49.5%
a group of people posing for a photo 49.4%

Text analysis

Amazon

(F