Human Generated Data

Title

Untitled (family outside on patio overlooking lake)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17706

Human Generated Data

Title

Untitled (family outside on patio overlooking lake)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.4
Person 99.4
Restaurant 99.1
Person 98.7
Person 98.2
Person 97.7
Person 96.1
Cafe 95.1
Porch 92.9
Patio 89.5
Furniture 87.6
Chair 87.6
Cafeteria 84.8
Meal 68
Food 68
Table 65.2
Outdoors 60.7
Sitting 59
Food Court 57.8
Shelter 57.7
Countryside 57.7
Nature 57.7
Rural 57.7
Building 57.7
Pergola 57.6
Dining Table 57.3
Flooring 55.5

Imagga
created on 2022-02-26

area 100
patio 100
structure 91.3
chair 39.1
table 33
interior 29.2
house 28.4
home 24.7
furniture 23.9
balcony 20
room 19.7
modern 19.6
architecture 18.7
wood 17.5
relaxation 16.7
floor 16.7
chairs 16.7
design 16.3
luxury 15.4
relax 15.2
glass 14
outdoor 13.8
sitting 13.7
indoor 13.7
inside 12.9
summer 12.9
seat 12.8
window 12.8
building 12.6
restaurant 12.4
decor 12.4
dining 12.4
decoration 12.3
sun 12.1
outside 12
people 11.7
hotel 11.5
vacation 11.5
travel 11.3
outdoors 11.2
style 11.1
umbrella 10.7
residential 10.5
urban 10.5
estate 10.4
lifestyle 10.1
business 9.7
real 9.5
empty 9.5
day 9.4
deck 9.3
city 9.1
kitchen 9
plant 9
sky 8.9
wooden 8.8
man 8.7
water 8.7
pool 8.6
shade 8.6
dinner 8.4
resort 8.4
garden 8.4
leisure 8.3
light 8
indoors 7.9
lunch 7.7
construction 7.7
beach 7.6
contemporary 7.5
bar 7.4
exterior 7.4
counter 7.3
holiday 7.2
hall 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

table 99.1
house 94.6
black and white 88.8
person 85.7
building 83.4
clothing 82.6
text 75.9
chair 71.4
man 64.3
vase 63.3
coffee table 61.7
tableware 50.8
furniture 23.8

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 58.2%
Calm 96.8%
Sad 1.1%
Surprised 0.9%
Happy 0.4%
Disgusted 0.3%
Fear 0.3%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 29-39
Gender Female, 97.4%
Calm 63.5%
Happy 17.7%
Sad 10.4%
Angry 3.1%
Disgusted 2.7%
Confused 1.4%
Surprised 0.8%
Fear 0.4%

AWS Rekognition

Age 28-38
Gender Male, 67.6%
Calm 80.3%
Sad 13.7%
Happy 2.5%
Confused 1.4%
Disgusted 0.7%
Surprised 0.7%
Angry 0.5%
Fear 0.2%

AWS Rekognition

Age 47-53
Gender Male, 97.4%
Sad 94.2%
Calm 3%
Confused 0.9%
Disgusted 0.7%
Fear 0.4%
Happy 0.4%
Surprised 0.2%
Angry 0.2%

AWS Rekognition

Age 19-27
Gender Female, 50.3%
Calm 56.9%
Happy 33.3%
Sad 4.1%
Disgusted 1.7%
Angry 1.3%
Fear 1.2%
Confused 0.9%
Surprised 0.6%

AWS Rekognition

Age 26-36
Gender Male, 97.5%
Calm 99.8%
Surprised 0.1%
Confused 0.1%
Disgusted 0%
Sad 0%
Happy 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

an old photo of a building 85.3%
a close up of an old building 81.9%
a person standing in front of a building 67.7%

Text analysis

Amazon

6
،

Google

XAGON
-YT33A2
MJI
--
MJIヨー-YT33A2--XAGON