Human Generated Data

Title

Untitled (woman looking at view of river from balcony of retirement home)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16094.3

Human Generated Data

Title

Untitled (woman looking at view of river from balcony of retirement home)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16094.3

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.8
Human 99.8
Person 98.9
Person 98.4
Person 98.3
Handrail 98.2
Banister 98.2
Railing 95.1
Person 94.5
Person 93.8
Person 91.9
Patio 87.4
Porch 85.7
Person 84.5
Person 84.3
Person 83.3
Person 78.7
Outdoors 76
Person 68.5
Person 60.1
Wood 59.5
Pergola 56.8

Clarifai
created on 2023-10-29

beach 99.4
people 99.2
street 98.9
sea 98.8
travel 98.8
girl 98.7
architecture 98.7
hotel 98.4
ocean 98.4
city 98.1
summer 97.9
water 97.4
light 97.3
sky 96.1
balcony 96.1
resort 95.9
vacation 95.8
tree 95.5
woman 95.4
house 95.4

Imagga
created on 2022-02-11

city 31.6
building 25.8
bridge 24.7
structure 24.5
architecture 23.9
sky 21.3
balcony 21.2
car 21.1
urban 20.1
travel 17.6
modern 14.7
landmark 14.4
conveyance 13.9
transportation 13.4
ocean 12.4
tourism 12.4
traffic 12.3
window 12.1
water 12
industry 12
passenger car 11.8
road 11.7
vehicle 11.7
business 11.5
street 11
transport 11
office 10.9
barrier 10.7
vacation 10.6
passenger 10.6
buildings 10.4
tourist 10.2
wheeled vehicle 10.2
sea 10.2
shuttle bus 10.1
house 10
tower 9.8
reflection 9.7
landscape 9.7
downtown 9.6
bay 9.4
gate 9.4
clouds 9.3
people 8.9
new 8.9
river 8.9
steel 8.8
light 8.7
highway 8.7
public transport 8.4
old 8.4
area 8.3
support 8.1
shuttle 8
glass 7.8
construction 7.7
skyscraper 7.7
outdoor 7.6
obstruction 7.6
cityscape 7.6
trip 7.5
town 7.4
tramway 7.4
island 7.3
holiday 7.2
interior 7.1
summer 7.1

Google
created on 2022-02-11

Water 95.8
Sky 94.3
Plant 91.5
Black 89.5
Tree 88.1
Shade 84.3
Travel 81.8
Leisure 80.7
Rectangle 80.2
Tints and shades 77.4
Urban design 75.6
Wood 74.6
Lake 71.4
T-shirt 69.8
Fence 69.6
Metal 68.2
Handrail 66.2
Shorts 64.4
Room 63.4
Roof 62.5

Microsoft
created on 2022-02-11

outdoor 94.6
person 91.3
clothing 86.4
tree 84.7
text 82.2
sky 77.3
water 67.1
vacation 51.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 81.2%
Calm 95.7%
Sad 1.6%
Confused 0.6%
Fear 0.5%
Happy 0.5%
Surprised 0.5%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 6-12
Gender Female, 98.9%
Sad 71.8%
Happy 18.8%
Calm 6%
Fear 1.2%
Disgusted 1.1%
Angry 0.5%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 24-34
Gender Male, 99.1%
Calm 98.5%
Sad 0.4%
Happy 0.4%
Disgusted 0.3%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.4%
Calm 92.1%
Surprised 1.6%
Sad 1.2%
Angry 1.2%
Happy 1.2%
Fear 1%
Disgusted 1%
Confused 0.7%

AWS Rekognition

Age 22-30
Gender Male, 99.4%
Calm 98.2%
Sad 0.6%
Happy 0.4%
Disgusted 0.3%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 26-36
Gender Male, 94.2%
Calm 88.1%
Sad 5.2%
Confused 1.7%
Angry 1.4%
Happy 1.2%
Fear 0.9%
Disgusted 0.9%
Surprised 0.6%

AWS Rekognition

Age 40-48
Gender Male, 98.9%
Disgusted 51%
Sad 12.6%
Fear 8.8%
Happy 7.5%
Confused 7.4%
Calm 5.2%
Angry 5.1%
Surprised 2.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.8%
Person 98.9%
Person 98.4%
Person 98.3%
Person 94.5%
Person 93.8%
Person 91.9%
Person 84.5%
Person 84.3%
Person 83.3%
Person 78.7%
Person 68.5%
Person 60.1%

Categories

Text analysis

Amazon

V
MACOM
MJIR MACOM
MJIR

Google

XACOA
XACOA