Human Generated Data

Title

Untitled ("Mrs. W. E. Corey playing cards with wounded officers")
Date

1918
People

Artist: R. Gallivan, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.744

Human Generated Data

Title

Untitled ("Mrs. W. E. Corey playing cards with wounded officers")

People

Artist: R. Gallivan, American 20th century

Date

1918

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.744

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Person 99.3
Sitting 99.2
Person 99.2
Person 99.1
Restaurant 98.9
Chair 97.2
Furniture 97.2
Cafe 96.7
Person 95.3
Chair 94
Person 92.9
Person 85.2
Cafeteria 78.8
Table 69.8
Shoe 65.1
Clothing 65.1
Footwear 65.1
Apparel 65.1
Meal 64.7
Food 64.7
People 63.9
Dining Table 59.4
Tabletop 58.5
Food Court 56.8
Person 55.6
Flooring 55.2

Clarifai
created on 2023-10-25

people 100
monochrome 98.8
street 98.7
group 98.2
group together 97.4
man 97.2
adult 96.9
furniture 96.8
woman 95.7
child 95.2
many 93.6
black and white 92
art 91.1
boy 91
chair 88.5
seat 88.3
administration 83.3
wear 81.4
recreation 81.4
music 80.2

Imagga
created on 2022-01-08

chair 58
table 49.2
restaurant 45.8
interior 42.5
room 37.7
furniture 35.8
house 31.8
building 28.5
chairs 28.4
structure 25.5
home 24.7
dining 23.8
wood 21.7
seat 21.1
patio 20.5
floor 20.5
cafeteria 20.4
design 18.6
glass 18
modern 17.5
inside 17.5
window 17.4
tables 16.7
indoor 16.4
architecture 16.4
dinner 16.3
decor 15.9
contemporary 15
empty 14.6
hotel 13.4
hall 13.2
style 12.6
lunch 12.2
area 12.1
plant 11.9
kitchen 11.8
food 11.8
decoration 11.6
indoors 11.4
sun 11.3
sitting 11.2
luxury 11.2
summer 10.9
relaxation 10.9
barroom 10.8
wooden 10.5
urban 10.5
outdoors 10.4
classroom 10.4
day 10.2
lifestyle 10.1
nobody 10.1
eat 10.1
drink 10
lamp 9.6
comfortable 9.6
decorate 9.5
light 9.4
relax 9.3
coffee 9.3
stove 8.9
residential 8.6
resort 8.4
outdoor 8.4
place 8.4
city 8.3
vacation 8.2
folding chair 8.1
drawer 7.9
stool 7.9
counter 7.9
diner 7.8
scene 7.8
wall 7.7
estate 7.6
office 7.4
bar 7.4
meal 7.3
business 7.3
people 7.3
stylish 7.2
work 7

Google
created on 2022-01-08

Table 94.7
Furniture 93.4
Chair 90.5
Black-and-white 85.2
Tree 85.2
Style 83.8
Adaptation 79.2
Monochrome 73.7
Monochrome photography 73.6
Art 73.2
Room 69.9
Coffee table 68.5
Event 66.5
Sitting 65.7
Painting 65.4
Vintage clothing 65.3
Conversation 65.2
History 64.2
Visual arts 63.3
Stock photography 62.7

Microsoft
created on 2022-01-08

text 96.3
chair 94.3
black and white 90.5
table 90.5
clothing 90.1
person 89
white 70.8
man 68.6
woman 64.5
old 57.4
vintage 29.1
furniture 25.7
family 15.4
several 12.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 79.1%
Angry 15.9%
Sad 1.5%
Confused 1.1%
Disgusted 0.8%
Fear 0.6%
Surprised 0.6%
Happy 0.4%

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Sad 96.4%
Calm 2.9%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 20-28
Gender Male, 93.1%
Calm 45.5%
Happy 22.1%
Angry 12.2%
Sad 6.2%
Surprised 4.3%
Disgusted 4%
Confused 3.2%
Fear 2.5%

AWS Rekognition

Age 45-51
Gender Male, 92.9%
Sad 25.6%
Disgusted 24.9%
Confused 22.9%
Calm 15.3%
Angry 6.5%
Fear 1.8%
Surprised 1.7%
Happy 1.3%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Calm 97.6%
Sad 0.6%
Confused 0.6%
Surprised 0.5%
Angry 0.3%
Disgusted 0.2%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 20-28
Gender Male, 97.6%
Fear 72.3%
Calm 8.5%
Surprised 6.4%
Confused 6%
Disgusted 2.7%
Sad 1.9%
Happy 1.4%
Angry 0.7%

AWS Rekognition

Age 16-22
Gender Female, 76.3%
Calm 98.6%
Sad 1.2%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Calm 76.8%
Happy 13.4%
Surprised 4.1%
Confused 2.6%
Angry 1.2%
Disgusted 0.8%
Fear 0.6%
Sad 0.5%

AWS Rekognition

Age 48-54
Gender Male, 99.2%
Happy 96.6%
Surprised 1.1%
Sad 0.7%
Calm 0.5%
Fear 0.3%
Disgusted 0.3%
Confused 0.2%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chair 97.2%
Shoe 65.1%

Categories

Imagga

interior objects 90.9%
paintings art 5.4%
streetview architecture 1.5%

Text analysis

Amazon

8 2-Part