Human Generated Data

Title

Untitled (group photograph behind large square banquet table)

Date

1939

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3962

Human Generated Data

Title

Untitled (group photograph behind large square banquet table)

People

Artist: Durette Studio, American 20th century

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 99.5
Person 99.5
Leisure Activities 99.5
Musical Instrument 99.5
Piano 99.5
Furniture 99
Tabletop 98.7
Person 98.6
Person 96.8
Person 96.6
Person 96.5
Person 95.1
Table 95
Person 92.2
Room 91.4
Indoors 91.4
Person 90.9
Person 90.8
Person 89.1
Flooring 88.4
Person 88.4
Dining Table 86.6
Person 81
Person 80.7
Person 78.3
Lighting 76.2
Person 71.5
People 70.6
Floor 68.7
Crowd 68.1
Person 64.2
Person 60.1
Game 59.6
Chair 57
Reception 56
Audience 55.4
Workshop 55.3

Clarifai
created on 2019-06-01

dug-out pool 98
inside 97
table 96.3
chair 96.1
furniture 95.9
room 93.6
modern 92.2
luxury 90.5
seat 90.5
indoors 87
city 87
architecture 85.8
house 84.9
people 83.9
travel 79.1
water 77.6
contemporary 77.6
monochrome 77.5
image 76.2
design 76

Imagga
created on 2019-06-01

room 63.7
interior 60.1
furniture 48
modern 38.6
house 36.8
home 35.1
table 34.2
case 34
counter 32.9
floor 28.8
inside 28.5
decor 27.4
architecture 27.3
luxury 26.6
hall 26.4
apartment 24.9
kitchen 24.7
wood 23.3
design 23.1
lamp 22.9
classroom 21.7
window 21.2
3d 20.9
residential 19.1
chair 18.9
indoors 18.4
indoor 18.3
light 18
comfortable 17.2
glass 17.1
sink 16.8
clean 16.7
empty 16.3
estate 16.1
wall 15.8
dining 15.2
living 15.2
contemporary 15
sofa 14.4
cabinet 13.8
domestic 13.6
nobody 13.2
hotel 12.4
steel 12.4
real 12.3
decoration 12.3
stove 12
cook 11.9
style 11.9
chairs 11.8
building 11.7
luxurious 11.7
expensive 11.5
cooking 11.4
relax 11
restaurant 10.9
faucet 10.8
mansion 10.8
stainless 10.7
new 10.5
relaxation 10
tile 10
vessel 10
oven 9.8
resort hotel 9.8
residence 9.7
carpet 9.7
equipment 9.7
vase 9.7
food 9.7
wooden 9.7
urban 9.6
render 9.5
lifestyle 9.4
lights 9.3
bar 9.2
business 9.1
bathtub 9.1
stylish 9
public 8.7
lighting 8.7
comfort 8.7
construction 8.6
space 8.5
classic 8.4
plant 8.2
dining room 7.9
elegant 7.7
decorate 7.6
dinner 7.6
lifestyles 7.6
elegance 7.6
drink 7.5
city 7.5
place 7.5
seat 7.3
appliance 7.2
tub 7.1
office 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

table 98.5
furniture 87.3
black and white 80.7
white 70.7
old 45.3
line 18.5
several 11.6

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 51.2%
Happy 46.1%
Sad 51.2%
Confused 45.4%
Angry 45.5%
Disgusted 45.4%
Surprised 45.4%
Calm 46.1%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Happy 49.5%
Confused 49.5%
Angry 49.5%
Disgusted 50.2%
Surprised 49.5%
Sad 49.5%
Calm 49.7%

AWS Rekognition

Age 15-25
Gender Female, 52.3%
Surprised 46.2%
Calm 46.5%
Disgusted 45.6%
Confused 46.2%
Sad 47.7%
Happy 46.1%
Angry 46.8%

AWS Rekognition

Age 48-68
Gender Male, 54.5%
Surprised 45.1%
Disgusted 45.1%
Calm 46.7%
Happy 45.1%
Sad 51.6%
Angry 46.3%
Confused 45.1%

AWS Rekognition

Age 48-68
Gender Female, 50.4%
Disgusted 49.5%
Happy 49.8%
Surprised 49.5%
Sad 49.8%
Angry 49.5%
Confused 49.6%
Calm 49.7%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Disgusted 49.6%
Calm 49.6%
Angry 49.5%
Sad 49.9%
Happy 49.6%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Angry 49.6%
Happy 49.5%
Confused 49.6%
Sad 49.7%
Calm 49.9%
Surprised 49.7%
Disgusted 49.5%

AWS Rekognition

Age 15-25
Gender Male, 50%
Calm 50.1%
Disgusted 49.6%
Sad 49.6%
Surprised 49.6%
Happy 49.5%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Angry 49.5%
Calm 50.2%
Sad 49.6%
Surprised 49.6%
Disgusted 49.5%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.5%
Calm 49.8%
Confused 49.6%
Sad 50%
Surprised 49.6%
Angry 49.6%
Happy 49.5%

AWS Rekognition

Age 14-25
Gender Female, 50.4%
Calm 49.8%
Surprised 49.6%
Disgusted 49.7%
Happy 49.6%
Sad 49.6%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 27-44
Gender Male, 50.3%
Confused 49.6%
Happy 49.6%
Calm 49.7%
Disgusted 49.8%
Sad 49.6%
Angry 49.6%
Surprised 49.6%

AWS Rekognition

Age 15-25
Gender Male, 50.5%
Angry 49.5%
Sad 50.3%
Happy 49.5%
Confused 49.6%
Surprised 49.5%
Calm 49.6%
Disgusted 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Happy 49.8%
Disgusted 49.6%
Angry 49.5%
Calm 49.9%
Sad 49.6%
Confused 49.5%
Surprised 49.6%

AWS Rekognition

Age 16-27
Gender Female, 50.1%
Happy 49.7%
Confused 49.5%
Angry 49.6%
Sad 49.7%
Calm 49.7%
Surprised 49.7%
Disgusted 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Disgusted 49.6%
Calm 49.9%
Surprised 49.6%
Angry 49.6%
Happy 49.6%
Sad 49.7%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Confused 49.6%
Sad 50%
Calm 49.7%
Happy 49.6%
Surprised 49.6%
Disgusted 49.5%
Angry 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Surprised 49.6%
Sad 50.1%
Happy 49.6%
Angry 49.5%
Disgusted 49.5%
Confused 49.6%
Calm 49.5%

AWS Rekognition

Age 35-53
Gender Male, 50.5%
Surprised 49.5%
Disgusted 50%
Calm 49.8%
Happy 49.5%
Sad 49.6%
Angry 49.6%
Confused 49.5%

AWS Rekognition

Age 57-77
Gender Female, 50.3%
Disgusted 49.5%
Calm 49.6%
Angry 49.5%
Sad 50.3%
Happy 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Sad 50.1%
Surprised 49.5%
Disgusted 49.6%
Angry 49.5%
Calm 49.7%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.2%
Angry 49.5%
Happy 49.5%
Calm 50.4%
Surprised 49.5%
Sad 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 49.7%
Confused 49.5%
Disgusted 49.7%
Surprised 49.5%
Angry 49.6%
Happy 49.5%
Calm 49.9%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Angry 49.5%
Sad 49.6%
Disgusted 49.5%
Happy 49.6%
Calm 50.3%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Angry 49.5%
Sad 49.9%
Happy 49.6%
Calm 49.6%
Confused 49.7%
Disgusted 49.6%
Surprised 49.7%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 49.5%
Happy 49.9%
Sad 49.6%
Disgusted 49.5%
Confused 49.5%
Calm 49.9%
Surprised 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Happy 49.7%
Disgusted 49.6%
Angry 49.6%
Calm 49.7%
Surprised 49.6%
Confused 49.6%
Sad 49.8%

AWS Rekognition

Age 35-52
Gender Male, 50.2%
Calm 50.1%
Surprised 49.6%
Disgusted 49.6%
Happy 49.6%
Sad 49.6%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Disgusted 49.6%
Confused 49.5%
Surprised 49.6%
Calm 49.8%
Happy 49.6%
Angry 49.5%
Sad 49.8%

Feature analysis

Amazon

Person 99.5%
Piano 99.5%

Captions

Microsoft

a vintage photo of a group of people in a room 84.1%
a vintage photo of a group of people standing next to a window 66.1%
a vintage photo of a group of people standing in a room 66%